-- Logs begin at Mon 2022-08-22 15:08:56 UTC, end at Mon 2022-08-22 16:50:16 UTC. -- Aug 22 15:48:13.300340 dv-cinder-854004-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 15:48:13 2022] *** Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: nodename: dv-cinder-854004-1-iscsi Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: machine: x86_64 Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: clock source: unix Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: pcre jit disabled Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: detected number of CPU cores: 4 Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: current working directory: / Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: detected binary path: /usr/bin/uwsgi-core Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: your processes number limit is 47680 Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: your memory page size is 4096 bytes Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: detected max file descriptor number: 2048 Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: lock engine: pthread robust mutexes Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: thunder lock: enabled Aug 22 15:48:13.310717 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 15:48:13.312383 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 15:48:13.350616 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: Python main interpreter initialized at 0x56386fdab9c0 Aug 22 15:48:13.350616 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: python threads support enabled Aug 22 15:48:13.350616 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: your server socket listen backlog is limited to 100 connections Aug 22 15:48:13.350616 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: your mercy for graceful operations on workers is 90 seconds Aug 22 15:48:13.351087 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 15:48:13.351087 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: *** Operational MODE: preforking *** Aug 22 15:48:13.351299 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: *** uWSGI is running in multiple interpreter mode *** Aug 22 15:48:13.351299 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: spawned uWSGI master process (pid: 105540) Aug 22 15:48:13.351538 dv-cinder-854004-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 15:48:13.354381 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: spawned uWSGI worker 1 (pid: 105541, cores: 1) Aug 22 15:48:13.354381 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: spawned uWSGI worker 2 (pid: 105542, cores: 1) Aug 22 15:48:13.354381 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 15:48:14.021136 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 15:48:14.021751 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 15:48:15.112415 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:48:15.112415 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: from cryptography.utils import int_from_bytes Aug 22 15:48:15.113154 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:48:15.113154 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: from cryptography.utils import int_from_bytes Aug 22 15:48:15.113804 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:48:15.113804 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: from cryptography.utils import int_from_bytes Aug 22 15:48:15.114206 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:48:15.114206 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: from cryptography.utils import int_from_bytes Aug 22 15:48:17.604784 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 15:48:17.605363 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 15:48:17.605363 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 15:48:17.605806 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 15:48:17.605889 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 15:48:17.606071 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 15:48:17.606214 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 15:48:17.606324 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 15:48:17.607225 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 15:48:17.609275 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.609382 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 15:48:17.609503 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.609503 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.609675 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.609771 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.609863 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.609950 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610029 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610121 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610237 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610339 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610425 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610515 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610610 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610714 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610800 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610885 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.610964 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611048 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611140 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611227 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854004-1-iscsi {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611308 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611500 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611592 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611710 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854004-1-iscsi {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611899 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.611998 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612118 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612240 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612337 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612430 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612520 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612606 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612742 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612879 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.612879 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.613696 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.613842 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.613961 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.614079 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.614212 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.614329 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.614436 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.614710 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.614841 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.614986 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.615224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.615345 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.615648 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.615744 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.615965 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.616061 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.616296 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.616394 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.616614 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.616836 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.617025 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854004-1-iscsi {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.617169 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.617345 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.617506 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.617663 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.617809 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.617981 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.618219 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854004-1-iscsi {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.618404 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.618558 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.618717 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.618847 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.619030 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.619167 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.619369 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.619611 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.619710 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.619927 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.620023 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.620247 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.620439 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.620552 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.620646 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.620876 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.620975 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.621186 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.621284 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.621519 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.621620 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.621837 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.621936 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.622157 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.622307 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.622480 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.622611 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.622788 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.622922 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.623100 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.623229 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.623370 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.623473 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.623689 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.623787 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.624016 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.624110 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.624341 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.624417 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.624597 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.624692 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.624927 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.625022 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.625161 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.625259 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.625470 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.625558 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.625797 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.625900 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.626095 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.626191 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.626349 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.626437 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.626672 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.626774 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.626995 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.627092 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.627302 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.627464 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.627633 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.627729 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.627940 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.628041 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.628249 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.628336 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.628559 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.628689 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.628896 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.628984 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.629206 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.629300 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.629515 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.629601 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.629835 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.629929 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.630155 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.630242 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.630475 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.630593 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.630779 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.630866 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.631099 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.631194 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.631453 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.631587 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.631768 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.631864 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.632079 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.632173 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.632402 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.632499 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.632715 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.632809 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.633023 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.633110 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.633330 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.633425 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.633652 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.633746 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.633958 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.634044 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.634265 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.634360 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.634523 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.634609 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.634828 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.634937 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.635138 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.635236 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.635477 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.635567 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.635763 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.635858 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.636067 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.636162 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.636373 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.636517 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.636678 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.636771 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.636988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.637081 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.637294 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.637380 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.637599 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.637692 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.637901 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.637988 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.638207 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.638300 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.638511 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.638605 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.638816 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.638910 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.639120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.639213 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.639448 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.639552 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.639755 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.639846 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.640061 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.640148 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.640365 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.640469 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.640670 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.640758 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.640977 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.641074 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.641286 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.641385 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.641591 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.641683 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.641897 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.641990 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.642202 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.642301 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.642506 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.642604 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.642822 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.642909 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.643127 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.643221 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.643456 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.643555 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.643767 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.643853 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.644073 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.644169 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.644406 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.644494 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.644712 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.644798 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.645021 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.645115 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.645331 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.645428 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.645636 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.645722 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.645941 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.646038 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.646249 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.646342 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.646556 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.646654 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.646862 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.646960 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.647167 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.647253 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.647495 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.647583 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.647800 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.647895 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.648100 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.648188 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.648404 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.648510 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.648709 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.648842 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.649013 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.649101 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.649313 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.649414 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.649622 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.649709 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.649940 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.650027 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.650250 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.650411 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.650557 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.650652 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.650863 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.650957 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.651180 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:48:17.651280 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.651544 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.651633 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.651881 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.651980 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.652213 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.652299 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.652526 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.652613 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.652841 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.652927 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.653170 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.653259 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.653489 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.653577 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.653800 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.653887 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.654114 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.654202 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.654438 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.654526 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.654762 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.654856 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.655095 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.655190 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.655451 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.655579 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.655774 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.655863 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.656101 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.656189 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.656416 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.656503 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.656739 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.656825 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.657072 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.657162 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.657397 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.657482 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.657712 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.657796 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.658036 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.658122 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.658367 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.658454 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.658695 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.658802 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.659010 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.659099 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.659371 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.659473 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.659672 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.659759 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.660518 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.660607 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.660837 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.660924 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.661165 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.661262 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.661479 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.661565 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.661796 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.661884 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.662111 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.662209 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.662426 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.662511 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.662744 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.662850 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.663058 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.663146 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.663444 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.663544 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.663714 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.663803 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.664025 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.664113 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.664341 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.664428 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.664656 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.664743 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.664972 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.665070 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.665293 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.665418 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.665609 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.665711 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.665924 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.666013 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.666235 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.666320 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.666542 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.666637 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.666851 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.666938 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.667160 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.667249 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.667496 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.667597 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.667803 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.667890 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.668113 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.668200 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.668439 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.668535 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.668786 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.668951 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.669159 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.669255 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.669471 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.669590 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.669786 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.669924 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.670101 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.670241 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.670416 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.670577 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.670728 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.670888 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.671044 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.671205 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.671378 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.671548 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.671691 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.671862 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.672021 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.672173 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.672337 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.672488 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.672648 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.672802 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.672974 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.673110 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.673284 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.673436 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.673594 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.673749 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.673913 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.674080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.674230 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.674367 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.674546 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.674675 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.674861 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.674982 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.675179 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.675300 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.676178 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.676293 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.676432 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.676530 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.676752 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.676840 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.677090 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.677181 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.677426 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.677522 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.677737 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.677825 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.678050 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.678136 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.678381 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.678468 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.678702 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.678797 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.679010 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.679102 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.679322 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.679468 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.679688 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.679790 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.679994 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.680082 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.680304 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.680392 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.680618 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.680714 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.680926 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.681014 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.681235 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.681330 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.681540 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.681634 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.681848 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.681942 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.682156 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.682288 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.682470 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.682559 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.682776 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.682880 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.683084 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.683176 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.683411 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.683504 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.683720 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.683836 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.684037 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.684129 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.684346 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.684437 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.684654 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.684756 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.684961 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.685057 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.685309 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.685397 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.685617 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.685706 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.685942 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.686031 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.686271 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.686405 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.686588 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.686677 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.686903 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.686990 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.687217 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.687304 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.687556 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.687645 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.687870 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.687957 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.688182 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.688268 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.688580 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.688805 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.688899 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.689128 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.689223 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.689442 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.689529 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.689763 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.689849 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.690070 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.690166 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.690393 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.690482 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.690704 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.690790 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.691028 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.691131 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.691883 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.691974 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.692206 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.692295 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.692533 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.692628 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.692857 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.692943 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.693174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.693261 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.693489 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.693586 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.693802 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.693897 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.694117 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.694210 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.694428 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.694515 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.694741 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.694832 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.695049 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.695142 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.695379 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.695469 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.695728 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.695882 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.696017 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.696104 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.696345 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.696479 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.696656 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.696742 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.696975 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.697076 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.697286 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.697372 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.697607 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.697694 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.697915 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.698016 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.698229 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.698316 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.698554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.698653 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.698870 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.698968 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.699182 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.699278 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.699523 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.699622 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.699833 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.700349 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.700439 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.700572 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.700705 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.700792 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.700872 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.700972 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.701053 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.701140 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.701334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.701432 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.701639 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.701727 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.701954 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.702055 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.702266 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.702363 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.702573 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.702665 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.702880 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.702969 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.703191 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.703289 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.703528 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.703617 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.703835 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.703923 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.704142 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.704277 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.704440 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.704523 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.704757 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.704845 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.705320 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.705427 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.705641 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.705718 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.705953 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.706037 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.706262 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.706347 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.706569 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.706662 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.707445 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.707541 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.707770 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.707889 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.708079 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.708181 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.708386 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.708474 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.708692 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.708788 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.709016 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.709110 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.709330 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.709417 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.709634 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.709729 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.709952 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.710046 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.710266 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.710365 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.710574 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.710662 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.710889 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.710976 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.711199 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.711348 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.711536 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.711623 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.711848 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.711934 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.712163 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.712250 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.712474 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.712561 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.712786 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.712886 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.713096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.713183 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.713405 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.713499 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.713715 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.713801 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.714023 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.714119 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.714330 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.714416 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.714647 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.714734 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.714960 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.715226 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.715317 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.715589 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.715680 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.715907 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.716036 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.716237 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.716485 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.716581 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.716821 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.716911 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.717138 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.717226 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.717459 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.717583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.717782 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.717878 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.718104 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.718205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.718437 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.718525 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.718746 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.718833 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.719057 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.719157 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.719395 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.719503 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.719709 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.719805 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.720014 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.720110 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.720321 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.720417 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.720630 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.720724 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.720936 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.721022 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.721241 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.721328 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.721546 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.721637 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.721854 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.721948 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.722158 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.722245 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.722488 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.722583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.722795 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.722882 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.723102 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.723195 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.723440 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.723530 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.723748 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.723847 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.724055 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.724142 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.724359 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.724488 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.724664 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.724760 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.724979 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.725064 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.725284 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.725378 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.725589 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.725684 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.725894 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.725982 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.726241 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.726380 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.726549 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.726646 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.726880 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.726967 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.727208 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.727294 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.727542 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.727631 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.727851 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.727940 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.728160 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.728248 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.728474 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.728563 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.728781 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.728868 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.729087 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.729173 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.729390 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.729478 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.729701 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.729786 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.730008 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.730094 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.730312 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.730400 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.730616 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.730710 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.730923 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.731017 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.731227 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.731318 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.731563 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.731661 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.731869 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.731966 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.732175 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.732262 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.732478 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.732571 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.732787 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.732882 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.733098 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.733192 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.733402 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.733489 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.733705 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.733800 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.734010 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.734103 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.734317 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.734402 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.734622 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.734709 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.734929 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.735014 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.735233 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.735356 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.735567 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.735656 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.735872 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.735966 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.736183 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.736283 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.736487 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.736574 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.736799 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.736926 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.737105 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.737192 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.737406 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.737501 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.737717 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.737815 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.738048 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.738149 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.738354 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.738443 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.738659 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.738749 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.738973 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.739081 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.739274 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.739431 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.739603 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.739695 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.739915 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.740021 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.740220 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.740307 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.740531 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.740621 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.740833 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.740928 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.741142 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.741229 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.741442 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.741529 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.741746 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.741834 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.742048 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.742146 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.742355 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.742441 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.742655 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.742742 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.742957 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.743045 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.743261 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.743368 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.743592 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.743682 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.743896 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.743986 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.744199 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.744285 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.744513 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.744601 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.744817 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.744916 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.745122 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.745218 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.745424 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.745521 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.745766 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.745866 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.746069 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.746165 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.746394 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.746482 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.746711 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.746809 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.747023 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.747119 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.747346 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.747435 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.747664 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.747751 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.747975 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.748076 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.748288 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.748375 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.748591 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.748678 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.748896 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.748997 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.749205 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.749291 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.749517 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.749604 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.749821 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.749909 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.750124 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.750211 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.750444 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.750533 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.750755 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.750844 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.751060 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.751147 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.751397 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.751488 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.751715 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.751811 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.752030 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.752127 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.752332 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.752417 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.752642 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.752730 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.752952 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.753037 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.753259 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.753357 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.753568 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.754155 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.754397 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.754484 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.754709 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.754852 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.755019 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.755105 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.755360 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.755449 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756269 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756424 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756424 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756551 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756551 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756680 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756746 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756821 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756888 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.756953 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.757241 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.757330 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.757480 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.757569 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.757788 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.757874 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.758097 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.758201 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.758403 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.758534 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.758710 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.758849 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.759019 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.759164 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.759346 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.759495 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.759778 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.759868 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.760117 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.760218 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.760407 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.760497 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.760715 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.760802 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.761021 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.761116 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.761331 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.761436 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.761650 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.761749 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.761965 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.762066 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.762272 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.762360 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.762632 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.762723 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.762938 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.763044 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.763251 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.763365 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.763602 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.763700 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.763908 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.764008 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.764214 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.764304 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.764521 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.764618 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.764842 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.764936 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.765148 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.765236 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.765451 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.765547 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.765755 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.765871 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.766163 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.766273 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.766416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.766520 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.766715 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.766887 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.767127 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.767262 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.767560 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.767664 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.767756 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.767911 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.768156 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.768248 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.768469 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.768566 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.768781 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.768869 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.769104 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.769190 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.769480 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.769596 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.769809 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.769909 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.770116 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.770205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.770433 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.770531 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.770747 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.770843 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.771052 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.771146 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.771406 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.772040 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.772226 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.772326 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.772543 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.772633 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.772849 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.772944 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.773172 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.773275 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.773494 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.773582 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.773809 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.773897 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.774132 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.774221 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.774511 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.774597 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.774822 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.774918 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.775132 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.775222 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.775474 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.775563 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.775788 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.775876 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.776097 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.776185 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.776404 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.776537 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.776720 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.776808 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.777025 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.777114 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.777333 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.777420 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.777642 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.777738 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.777947 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.778038 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.778255 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.778349 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.778564 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.778665 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.778872 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.778961 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.779175 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.779263 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.779507 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.779616 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.779831 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.779920 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.780138 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.780226 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.780449 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.780545 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.780764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.780891 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.781085 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.781210 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.781405 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.781521 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.781712 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.781830 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.782034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.782167 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.782346 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.782471 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.782651 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.782784 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.782956 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.783109 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.783261 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.783466 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.783633 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.783800 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.783941 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.784114 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.784262 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.784453 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.784592 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.784789 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.784943 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.785146 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.785258 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.785470 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.785590 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.785802 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.785904 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.786114 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.786234 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.786427 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.786565 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.786744 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.786886 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.787056 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.787193 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.787390 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.787527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.787704 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.787839 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.788020 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.788147 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.788328 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.788456 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.788637 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.788766 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.788994 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.789090 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.789274 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.789361 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.789584 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.789680 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.789912 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.790009 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.790227 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.790315 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.790538 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.790639 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.790850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.790939 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.791158 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.791246 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.791486 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.791587 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.791796 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.791885 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.792108 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.792245 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.792454 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.792542 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.792760 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.792846 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.793089 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.793175 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.793400 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.793487 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.793738 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.793838 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.794033 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.794120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.794348 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.794436 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.794662 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.794748 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.794977 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.795071 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.795290 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.795428 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.795628 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.795715 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.795943 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.796047 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.796254 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.796343 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.796569 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.796816 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.796904 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.797155 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.797255 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.797474 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.797729 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.797817 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.798061 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.798161 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.798378 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.798466 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.798691 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.798778 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.799003 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.799169 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.799318 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.799419 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.799656 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.799742 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.799970 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.800059 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.800283 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.800372 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.801131 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.801232 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.801441 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.801530 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.801768 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.801856 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.802091 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.802196 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.802410 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.802496 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.802729 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.802818 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.803047 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.803143 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.803385 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.803502 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.803706 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.803806 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.804022 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.804111 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.804341 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.804427 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.804663 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.804758 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.804975 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.805070 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.805287 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.805373 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.805600 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.805685 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.805915 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.806004 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.806226 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.806302 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.806538 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.806628 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.806852 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.806957 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.807801 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.807925 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.807925 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808083 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808083 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808220 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808289 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808357 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808425 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808501 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808717 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.808812 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.809052 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.809130 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.809369 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.809458 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.809681 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.809894 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.809982 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.810216 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.810312 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.810734 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.810851 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.811075 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.811172 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.811432 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.811551 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.811760 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.811863 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.812081 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.812174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.812400 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.812504 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.812711 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.812803 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.813022 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.813121 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.813330 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.813424 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.813638 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.813725 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.813945 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.814032 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.814251 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.814347 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.814556 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.814644 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.814864 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.814959 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.815175 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.815263 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.815510 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.815610 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.815831 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.816047 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.816187 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.816965 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.817242 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.817380 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.817577 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.817675 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.817900 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.817996 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.818231 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.818319 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.818544 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.818640 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.818862 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.818949 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.819174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.819261 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.819510 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.819605 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.819827 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.819902 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.820136 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.820233 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.820444 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.820545 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.820754 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.820844 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.821058 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.821144 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.821364 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.821460 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.821668 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.821754 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.821977 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.822065 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.822283 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.822372 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.822595 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.822693 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.822899 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.822987 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.823207 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.823295 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.823539 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.823628 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.823853 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.823952 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.824192 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.824289 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.824507 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.824814 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.824900 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.825120 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.825378 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.825480 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.825710 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.825789 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.826023 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.826110 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.826329 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.826420 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.826639 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.826728 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.826951 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.827056 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.827265 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.827395 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.827597 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.827688 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.827907 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.828014 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.828213 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.828302 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.828539 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.828627 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.828844 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.828974 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.829208 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.829307 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.829526 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.829613 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.829837 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.829941 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.830413 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.830504 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.830728 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.830819 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.831040 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.831130 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.831416 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.831528 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.831737 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.832317 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.832782 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.832878 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.833119 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.833212 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.833442 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.833544 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.833778 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.833872 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.834111 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.834205 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.834418 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.834519 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.834724 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.834817 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.835031 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.835125 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.835377 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.835485 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.835694 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.835795 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.836005 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.836099 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.836317 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.836424 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.836628 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.836738 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.836945 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.837084 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.837256 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.837355 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.837571 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.837667 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.837881 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.837968 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.838192 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.838280 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.838504 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.838598 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.838818 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.838924 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.839127 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.839224 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.839460 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.839550 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.839770 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.839869 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.840085 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.840174 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.840425 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.840520 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.840746 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.840846 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.841062 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.841149 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.841379 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.841466 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.841695 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.841791 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.842010 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.842097 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.842318 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.842405 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.842664 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.842815 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.842938 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.843025 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.843250 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.843368 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.843604 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.843695 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.843925 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.844027 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.844225 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.844313 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.844646 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.844741 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.844959 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.845046 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.845278 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.845374 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.845622 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.845724 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.845909 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.846010 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.846230 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.846331 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.846548 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.846643 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.846866 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.846953 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.847186 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.847282 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.848064 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.848162 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.848391 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.848478 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.848734 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.848833 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.849064 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.849160 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.849390 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.849486 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.849700 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.849788 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.850005 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.850099 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.850311 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.850408 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.850622 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.850720 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.850944 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.851032 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.851258 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.851390 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.851598 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.851686 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.851904 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.851991 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.852221 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.852321 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.852525 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.852620 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.852833 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.852920 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.853137 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.853232 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.853444 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.853531 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.853751 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.853837 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.854056 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.854151 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.854358 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.854451 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.854661 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.854750 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.854968 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.855066 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.855273 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.855392 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.855597 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.855698 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.855908 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.856028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.856213 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.856302 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.856518 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.856615 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.856825 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.856916 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.857144 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.857324 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.857432 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.857520 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.857763 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.857853 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.858096 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.858225 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.858412 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.858510 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.858731 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.858832 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.859042 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.859131 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.859388 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.859515 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.859703 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.859891 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.860032 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.860108 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.860336 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.860500 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.860652 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.860739 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.860962 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.861050 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.861294 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.861391 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.861606 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.861701 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.861919 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.862006 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.862228 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.862316 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.862540 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.862631 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.862850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.862937 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.863186 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.863276 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.863542 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.863661 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.863874 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.863994 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.864186 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.864307 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.864513 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.864639 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.864834 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.864963 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.865155 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.865288 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.865472 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.865610 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.865787 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.865928 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.866119 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.866263 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.866435 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.866580 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.866753 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.866903 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.867065 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.867218 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.867401 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.867559 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.867720 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.867877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.868039 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.868199 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.868353 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.868517 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.868666 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.868833 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.868984 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.869154 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.869301 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.869476 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.869630 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.869807 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.869955 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.870138 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.870267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.870454 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.870595 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.870854 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.870950 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.871189 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.871300 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.871567 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.871659 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.871886 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.871981 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.872236 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.872325 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.872571 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.872660 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.872891 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.872978 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.873198 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.873294 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.873445 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 15:48:17.873541 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:48:17.873742 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 15:48:18.029614 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO dbcounter [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Registered counter for database nova_api Aug 22 15:48:18.030814 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO dbcounter [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Registered counter for database nova_api Aug 22 15:48:18.051739 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:18.054564 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_db.sqlalchemy.engines [None req-0764743f-d760-419d-b294-4dcfed870174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:18.058536 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writer thread running {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:18.061373 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writer thread running {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:18.115303 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.context [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9b6efaf-c661-4a43-9954-830521140ee8(cell1) {{(pid=105541) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 15:48:18.118553 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.context [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9b6efaf-c661-4a43-9954-830521140ee8(cell1) {{(pid=105542) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 15:48:18.119196 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_concurrency.lockutils [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:48:18.119706 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_concurrency.lockutils [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:48:18.121252 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_concurrency.lockutils [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:48:18.122000 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_concurrency.lockutils [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:48:18.122434 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:48:18.122530 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_concurrency.lockutils [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:48:18.122921 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:48:18.124451 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_concurrency.lockutils [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:48:18.124548 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:48:18.125260 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:48:18.125713 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:48:18.126453 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO dbcounter [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Registered counter for database nova_cell0 Aug 22 15:48:18.127741 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:48:18.129746 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO dbcounter [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Registered counter for database nova_cell0 Aug 22 15:48:18.131911 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO dbcounter [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Registered counter for database nova_cell1 Aug 22 15:48:18.135450 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO dbcounter [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Registered counter for database nova_cell1 Aug 22 15:48:18.140796 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:18.141833 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:18.142414 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_db.sqlalchemy.engines [None req-0764743f-d760-419d-b294-4dcfed870174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:18.147919 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writer thread running {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:18.148990 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writer thread running {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:18.150854 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writer thread running {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:18.286972 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_db.sqlalchemy.engines [None req-0764743f-d760-419d-b294-4dcfed870174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:18.292627 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writer thread running {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:18.297703 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO dbcounter [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Registered counter for database nova_cell0 Aug 22 15:48:18.302294 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO dbcounter [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Registered counter for database nova_cell0 Aug 22 15:48:18.307500 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:18.309311 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_db.sqlalchemy.engines [None req-0764743f-d760-419d-b294-4dcfed870174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:18.312114 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writer thread running {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:18.313736 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writer thread running {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:18.649512 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: WARNING keystonemiddleware.auth_token [None req-0764743f-d760-419d-b294-4dcfed870174 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 15:48:18.651440 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: WARNING keystonemiddleware.auth_token [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 15:48:18.656804 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: WARNING keystonemiddleware.auth_token [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 15:48:18.658671 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: WARNING keystonemiddleware.auth_token [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 15:48:18.996057 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: WARNING keystonemiddleware.auth_token [None req-0764743f-d760-419d-b294-4dcfed870174 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 15:48:19.000175 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: WARNING keystonemiddleware.auth_token [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 15:48:19.001916 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: WARNING keystonemiddleware.auth_token [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 15:48:19.006653 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: WARNING keystonemiddleware.auth_token [None req-ac8a7f2a-fd4d-4df4-9ff6-1f71356fc47c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 15:48:19.008446 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56386fdab9c0 pid: 105542 (default app) Aug 22 15:48:19.009808 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:48:19.011017 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-0764743f-d760-419d-b294-4dcfed870174 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001718 Aug 22 15:48:19.011424 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Mon Aug 22 15:48:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:48:19.012016 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56386fdab9c0 pid: 105541 (default app) Aug 22 15:49:39.212843 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:49:39.214478 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-0764743f-d760-419d-b294-4dcfed870174 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002390 Aug 22 15:49:39.215276 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:49:39.243661 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writing DB stats nova_api:SELECT=3 {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.244980 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writing DB stats nova_cell1:SELECT=3 {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.246518 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writing DB stats nova_cell0:SELECT=3 {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.248055 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:40.699758 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-5af4e8ec-ee4a-4ca6-a182-f067c7660cbf admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:49:40.759181 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-5af4e8ec-ee4a-4ca6-a182-f067c7660cbf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.532322 Aug 22 15:49:40.760087 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Mon Aug 22 15:49:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:43.818911 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-0764743f-d760-419d-b294-4dcfed870174 None None] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:49:43.819972 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-0764743f-d760-419d-b294-4dcfed870174 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 22 15:49:43.820452 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:49:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:49:44.551160 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-fe8eb3a2-c276-4941-ba87-a7277171d758 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1"}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:49:44.575444 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:49:44.575444 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: warnings.warn(msg) Aug 22 15:49:44.612565 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-fe8eb3a2-c276-4941-ba87-a7277171d758 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.781150 Aug 22 15:49:44.614395 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:49:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 15:49:44.922700 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-405a3bbb-fee2-43a2-b523-62ffe4ee3c9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:49:44.933078 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:49:44.933078 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: warnings.warn(msg) Aug 22 15:49:44.944814 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_api:SELECT=3 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.945435 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_cell0:SELECT=3 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.946316 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_cell1:SELECT=3 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.947178 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.997570 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-405a3bbb-fee2-43a2-b523-62ffe4ee3c9b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.367151 Aug 22 15:49:44.999376 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Aug 22 15:49:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:47.927221 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-fe8eb3a2-c276-4941-ba87-a7277171d758 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:49:47.930233 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-fe8eb3a2-c276-4941-ba87-a7277171d758 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003772 Aug 22 15:49:47.931001 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:49:48.634418 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-16f781ed-a0b9-44f6-8c95-dcb300721767 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "id": "d1"}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:49:48.655016 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:49:48.655016 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: warnings.warn(msg) Aug 22 15:49:48.679580 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-16f781ed-a0b9-44f6-8c95-dcb300721767 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.741021 Aug 22 15:49:48.680284 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:49:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 15:49:48.697626 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-b8ec2938-607c-4e03-9259-55b8946e7fec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:49:48.703377 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:49:48.703377 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: warnings.warn(msg) Aug 22 15:49:48.767060 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-b8ec2938-607c-4e03-9259-55b8946e7fec admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076189 Aug 22 15:49:48.768336 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Aug 22 15:49:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:51.690668 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-16f781ed-a0b9-44f6-8c95-dcb300721767 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:49:51.692876 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-16f781ed-a0b9-44f6-8c95-dcb300721767 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003881 Aug 22 15:49:51.694197 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:49:51 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:49:52.388870 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-ac6847c9-a990-4e49-9ca4-06b24e8f9326 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "disk": 10, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:49:52.418684 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-ac6847c9-a990-4e49-9ca4-06b24e8f9326 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.716519 Aug 22 15:49:52.419755 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:49:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:49:52.434333 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-297d5b56-364d-466f-8a48-35ecc12a587b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:49:52.470588 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-297d5b56-364d-466f-8a48-35ecc12a587b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040248 Aug 22 15:49:52.471782 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Aug 22 15:49:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:49:55.244775 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-ac6847c9-a990-4e49-9ca4-06b24e8f9326 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:49:55.246531 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-ac6847c9-a990-4e49-9ca4-06b24e8f9326 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 Aug 22 15:49:55.246957 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:49:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:49:55.888077 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-1e269f1b-a4e2-4a01-899a-faf54c548318 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "ram": 2048, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:49:55.924047 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-1e269f1b-a4e2-4a01-899a-faf54c548318 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.669011 Aug 22 15:49:55.925520 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:49:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 15:49:55.946538 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-56f98f70-20f8-40d2-9518-e50655bc4c17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:49:55.992196 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-56f98f70-20f8-40d2-9518-e50655bc4c17 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052136 Aug 22 15:49:55.999539 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Aug 22 15:49:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:59.652091 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-1e269f1b-a4e2-4a01-899a-faf54c548318 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:49:59.655171 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-1e269f1b-a4e2-4a01-899a-faf54c548318 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002450 Aug 22 15:49:59.658418 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:49:59 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:00.251398 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-dbc7d803-ace3-409f-a6f7-3a7554b54767 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "rxtx_factor": 1.0}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:00.279985 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-dbc7d803-ace3-409f-a6f7-3a7554b54767 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.613089 Aug 22 15:50:00.280696 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:49:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:00.293407 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-4efb4021-b09c-4d9c-8c05-17221284cb68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:00.326670 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-4efb4021-b09c-4d9c-8c05-17221284cb68 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036985 Aug 22 15:50:00.327279 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Aug 22 15:50:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:50:03.087587 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-dbc7d803-ace3-409f-a6f7-3a7554b54767 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:03.089601 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-dbc7d803-ace3-409f-a6f7-3a7554b54767 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002785 Aug 22 15:50:03.090644 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:03.770200 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-86546042-92f7-43e1-9be7-e4ac87d6e750 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:03.839882 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-86546042-92f7-43e1-9be7-e4ac87d6e750 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.737461 Aug 22 15:50:03.841525 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Mon Aug 22 15:50:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:50:06.822401 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-dbc7d803-ace3-409f-a6f7-3a7554b54767 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:06.823946 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-dbc7d803-ace3-409f-a6f7-3a7554b54767 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Aug 22 15:50:06.825679 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:50:07.476942 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-913ac8e7-2171-44ef-a347-c624bdf03be6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "disk": 1, "id": "1", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:07.501948 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-913ac8e7-2171-44ef-a347-c624bdf03be6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.667549 Aug 22 15:50:07.504790 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:50:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:07.523535 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-3d3c12f2-87ae-4609-bb4b-d95070956d5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:07.565325 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-3d3c12f2-87ae-4609-bb4b-d95070956d5f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048512 Aug 22 15:50:07.566318 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Aug 22 15:50:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:50:10.206920 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-913ac8e7-2171-44ef-a347-c624bdf03be6 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:10.208004 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-913ac8e7-2171-44ef-a347-c624bdf03be6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001787 Aug 22 15:50:10.208547 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:10.746117 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-6dd5c206-9e37-4588-bb56-395b863541a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:10.753210 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:10.769085 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-6dd5c206-9e37-4588-bb56-395b863541a0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.553538 Aug 22 15:50:10.769661 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:50:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 15:50:10.782992 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-6e4cacaa-00a7-4a21-841c-423ca28372f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:10.812565 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-6e4cacaa-00a7-4a21-841c-423ca28372f7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033811 Aug 22 15:50:10.813171 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Aug 22 15:50:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:50:13.732730 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-6dd5c206-9e37-4588-bb56-395b863541a0 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:13.733754 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-6dd5c206-9e37-4588-bb56-395b863541a0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 22 15:50:13.734179 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:14.289307 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-cd0230e8-8376-40e0-8c86-d01fc8ebc8f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:14.325943 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-cd0230e8-8376-40e0-8c86-d01fc8ebc8f4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.583079 Aug 22 15:50:14.327832 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:50:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:14.348835 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-69436c94-afb5-4c9f-8161-794da1d8de91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:14.401554 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-69436c94-afb5-4c9f-8161-794da1d8de91 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060047 Aug 22 15:50:14.404385 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Aug 22 15:50:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:50:17.795894 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-cd0230e8-8376-40e0-8c86-d01fc8ebc8f4 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:17.797947 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-cd0230e8-8376-40e0-8c86-d01fc8ebc8f4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Aug 22 15:50:17.798388 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:50:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:18.680788 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-6c0a4c6e-1734-4290-b8a9-2d185f6c26db admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "disk": 80}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:18.718516 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-6c0a4c6e-1734-4290-b8a9-2d185f6c26db admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.912369 Aug 22 15:50:18.719656 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:50:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:18.733080 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-92983572-8a2b-43fa-a205-e4e64a1c5401 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:18.740295 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:18.771976 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-92983572-8a2b-43fa-a205-e4e64a1c5401 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043705 Aug 22 15:50:18.773366 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Aug 22 15:50:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:50:21.854559 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-6c0a4c6e-1734-4290-b8a9-2d185f6c26db admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:21.855617 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-6c0a4c6e-1734-4290-b8a9-2d185f6c26db admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 22 15:50:21.856186 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:50:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:50:22.640148 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-4101ed5e-dc0a-45c2-954c-4e680d6b0a30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "disk": 160}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:22.672439 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-4101ed5e-dc0a-45c2-954c-4e680d6b0a30 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.804832 Aug 22 15:50:22.673352 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Aug 22 15:50:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:22.685849 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-661c0701-f136-454f-b101-2a7cccd4b407 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:22.718117 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-661c0701-f136-454f-b101-2a7cccd4b407 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035976 Aug 22 15:50:22.718720 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Aug 22 15:50:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:50:42.545213 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-4101ed5e-dc0a-45c2-954c-4e680d6b0a30 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:42.547541 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-4101ed5e-dc0a-45c2-954c-4e680d6b0a30 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002527 Aug 22 15:50:42.548321 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:42.561659 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:43.040157 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-ee2b3902-8f36-47e3-912b-6ab83bc57121 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:43.059972 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-ee2b3902-8f36-47e3-912b-6ab83bc57121 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.503074 Aug 22 15:50:43.060528 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Mon Aug 22 15:50:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:50:44.294086 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-4101ed5e-dc0a-45c2-954c-4e680d6b0a30 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:44.295439 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-4101ed5e-dc0a-45c2-954c-4e680d6b0a30 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001851 Aug 22 15:50:44.296083 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:50:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:44.953484 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d7617115-f000-42f8-9fe7-4a9bd5d6dceb admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:44.960714 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.wsgi [None req-d7617115-f000-42f8-9fe7-4a9bd5d6dceb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d7617115-f000-42f8-9fe7-4a9bd5d6dceb admin admin] Request method failure captured: Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Accept: application/json Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Accept-Encoding: gzip, deflate Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Connection: keep-alive Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Content-Length: 0 Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Host: 10.222.0.40 Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Openstack-Api-Version: compute 2.90 Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Openstack-System-Scope: None Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: User-Agent: python-novaclient Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Auth-Token: gAAAAABjA6XUAH5r1jrV4Coad_Q43Fo0wnACWFaLfAQt9UNBaPcSdnHq64owdXM_2iINWUR0EhSagzNm2xQrAoGO0PkNcs_HxABgNnb_WhUD4ZFOVyQS3fj5y9ow60sJ0qpuU00jV2B0iLYtN4gjX27f0D9ybIp2CHuRgH0_zkdKOVCxk2Vev28 Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Domain-Id: None Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Domain-Name: None Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Identity-Status: Confirmed Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Is-Admin-Project: True Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Domain-Id: default Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Domain-Name: Default Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Name: admin Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Role: reader,admin,member Aug 22 15:50:44.964334 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Roles: reader,admin,member Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3494c700c71b4f21bf6902173eefb916", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}] Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant: admin Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant-Name: admin Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User: admin Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Domain-Id: default Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Domain-Name: Default Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Id: b9ad904703784b73a4b1e6a16fa26389 Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Name: admin Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: method: > Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: exception: Flavor 42 could not be found. Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: action_args: {'id': '42'} Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:50:44.966812 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:44.968527 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:44.971267 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d7617115-f000-42f8-9fe7-4a9bd5d6dceb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:50:44.973409 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-d7617115-f000-42f8-9fe7-4a9bd5d6dceb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.522411 Aug 22 15:50:44.973409 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Aug 22 15:50:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 524 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 15:50:44.978690 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-bcca57b5-5dd8-43d9-a2ed-0736797596ba admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:44.983279 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:45.005548 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-bcca57b5-5dd8-43d9-a2ed-0736797596ba admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030813 Aug 22 15:50:45.006131 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 22 15:50:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:50:45.021315 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-4362d175-839b-4ce3-b8e3-2f98c0521978 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:45.069445 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-4362d175-839b-4ce3-b8e3-2f98c0521978 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.055479 Aug 22 15:50:45.070501 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 22 15:50:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:50:45.084449 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-27440334-253f-4a1e-9509-c3e64a5814cd admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:45.091200 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.wsgi [None req-27440334-253f-4a1e-9509-c3e64a5814cd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-27440334-253f-4a1e-9509-c3e64a5814cd admin admin] Request method failure captured: Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Accept: application/json Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Accept-Encoding: gzip, deflate Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Connection: keep-alive Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Content-Length: 0 Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Host: 10.222.0.40 Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Openstack-Api-Version: compute 2.90 Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Openstack-System-Scope: None Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: User-Agent: python-novaclient Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Auth-Token: gAAAAABjA6XUAH5r1jrV4Coad_Q43Fo0wnACWFaLfAQt9UNBaPcSdnHq64owdXM_2iINWUR0EhSagzNm2xQrAoGO0PkNcs_HxABgNnb_WhUD4ZFOVyQS3fj5y9ow60sJ0qpuU00jV2B0iLYtN4gjX27f0D9ybIp2CHuRgH0_zkdKOVCxk2Vev28 Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Domain-Id: None Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Domain-Name: None Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Identity-Status: Confirmed Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Is-Admin-Project: True Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Domain-Id: default Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Domain-Name: Default Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Name: admin Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Role: reader,admin,member Aug 22 15:50:45.095583 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Roles: reader,admin,member Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3494c700c71b4f21bf6902173eefb916", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}] Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant: admin Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant-Name: admin Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User: admin Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Domain-Id: default Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Domain-Name: Default Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Id: b9ad904703784b73a4b1e6a16fa26389 Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Name: admin Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: method: > Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: exception: Flavor 42 could not be found. Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: action_args: {'id': '42'} Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:50:45.098096 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:45.100028 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:45.102205 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-27440334-253f-4a1e-9509-c3e64a5814cd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:50:45.104454 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-27440334-253f-4a1e-9509-c3e64a5814cd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017256 Aug 22 15:50:45.104454 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Aug 22 15:50:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:46.222336 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-4362d175-839b-4ce3-b8e3-2f98c0521978 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:46.223458 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-4362d175-839b-4ce3-b8e3-2f98c0521978 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 22 15:50:46.223880 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:46.952017 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-e404ab54-a17c-43a3-b79f-67903404e0c7 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:46.958914 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.wsgi [None req-e404ab54-a17c-43a3-b79f-67903404e0c7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-e404ab54-a17c-43a3-b79f-67903404e0c7 admin admin] Request method failure captured: Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Accept: application/json Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Accept-Encoding: gzip, deflate Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Connection: keep-alive Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Content-Length: 0 Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Host: 10.222.0.40 Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Openstack-Api-Version: compute 2.90 Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Openstack-System-Scope: None Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: User-Agent: python-novaclient Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Auth-Token: gAAAAABjA6XWIgZiKW00A5fThP6aRj5Lx2u2xhaESuoRrVP6l9kJKPJ788J4-c1aw0CG5XUDrNnNm4nmWQZWc1v9vyoRSAbOT4MazBp09zdCxeXfwa2i_jfgdxAZ9ZxMJuDffJbHxhTYcoPAW54xhN43ErY_8qFxm5pDTT_8B6-3c6dsbgJdUgE Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Domain-Id: None Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Domain-Name: None Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Identity-Status: Confirmed Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Is-Admin-Project: True Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Domain-Id: default Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Domain-Name: Default Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Name: admin Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Role: reader,admin,member Aug 22 15:50:46.960514 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Roles: reader,admin,member Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3494c700c71b4f21bf6902173eefb916", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}] Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant: admin Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant-Name: admin Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User: admin Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Domain-Id: default Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Domain-Name: Default Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Id: b9ad904703784b73a4b1e6a16fa26389 Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Name: admin Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: method: > Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: exception: Flavor 84 could not be found. Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: action_args: {'id': '84'} Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:50:46.962259 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:46.963107 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:46.964554 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-e404ab54-a17c-43a3-b79f-67903404e0c7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:50:46.965948 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-e404ab54-a17c-43a3-b79f-67903404e0c7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.590174 Aug 22 15:50:46.965948 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Aug 22 15:50:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 591 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:46.972621 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-ac8b9574-6461-433f-ab26-1ffd7aa9436a admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:46.987995 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-ac8b9574-6461-433f-ab26-1ffd7aa9436a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019195 Aug 22 15:50:46.988579 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 22 15:50:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:50:46.998575 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-9a7f8b76-17da-43a6-8890-23bebd96a28a admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:47.017581 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-9a7f8b76-17da-43a6-8890-23bebd96a28a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022592 Aug 22 15:50:47.018077 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 22 15:50:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:50:47.030199 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-dc0e67b9-b618-40a8-adf4-09e7311d4d16 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:47.038578 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.wsgi [None req-dc0e67b9-b618-40a8-adf4-09e7311d4d16 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-dc0e67b9-b618-40a8-adf4-09e7311d4d16 admin admin] Request method failure captured: Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Accept: application/json Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Accept-Encoding: gzip, deflate Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Connection: keep-alive Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Content-Length: 0 Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Host: 10.222.0.40 Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Openstack-Api-Version: compute 2.90 Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Openstack-System-Scope: None Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: User-Agent: python-novaclient Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Auth-Token: gAAAAABjA6XWIgZiKW00A5fThP6aRj5Lx2u2xhaESuoRrVP6l9kJKPJ788J4-c1aw0CG5XUDrNnNm4nmWQZWc1v9vyoRSAbOT4MazBp09zdCxeXfwa2i_jfgdxAZ9ZxMJuDffJbHxhTYcoPAW54xhN43ErY_8qFxm5pDTT_8B6-3c6dsbgJdUgE Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Domain-Id: None Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Domain-Name: None Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Identity-Status: Confirmed Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Is-Admin-Project: True Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Domain-Id: default Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Domain-Name: Default Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Name: admin Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Role: reader,admin,member Aug 22 15:50:47.040224 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Roles: reader,admin,member Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3494c700c71b4f21bf6902173eefb916", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}] Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant: admin Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant-Name: admin Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User: admin Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Domain-Id: default Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Domain-Name: Default Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Id: b9ad904703784b73a4b1e6a16fa26389 Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Name: admin Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: method: > Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: exception: Flavor 84 could not be found. Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: action_args: {'id': '84'} Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:50:47.041822 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:47.042988 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:47.044416 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-dc0e67b9-b618-40a8-adf4-09e7311d4d16 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:50:47.045712 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-dc0e67b9-b618-40a8-adf4-09e7311d4d16 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017192 Aug 22 15:50:47.045712 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Aug 22 15:50:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:48.106252 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-9a7f8b76-17da-43a6-8890-23bebd96a28a admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:48.107262 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-9a7f8b76-17da-43a6-8890-23bebd96a28a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 22 15:50:48.107722 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:50:48.834595 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-cbd8afed-905e-4345-9c75-44c5a62778ec admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:48.841181 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.wsgi [None req-cbd8afed-905e-4345-9c75-44c5a62778ec admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-cbd8afed-905e-4345-9c75-44c5a62778ec admin admin] Request method failure captured: Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Accept: application/json Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Accept-Encoding: gzip, deflate Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Connection: keep-alive Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Content-Length: 0 Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Host: 10.222.0.40 Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Openstack-Api-Version: compute 2.90 Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Openstack-System-Scope: None Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: User-Agent: python-novaclient Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Auth-Token: gAAAAABjA6XXU_AsnAFiEZLkTNqb_EwN-MsjZD79Shv0tbSkMjPh7eAOQR0Pni2Z8ub-EQEyJxiu9qOG-s7B6XCxq7fU0x8zU3pwjRo5hXOsrppQ7nnQo44QlJNbN82kMHZalTfAJ7LV5dDvaV9nnPm8xsD8CzKaj7N9i9WYNbklJSIjbpzovoE Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Domain-Id: None Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Domain-Name: None Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Identity-Status: Confirmed Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Is-Admin-Project: True Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Domain-Id: default Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Domain-Name: Default Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Project-Name: admin Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Role: reader,admin,member Aug 22 15:50:48.842764 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Roles: reader,admin,member Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3494c700c71b4f21bf6902173eefb916", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}] Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant: admin Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-Tenant-Name: admin Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User: admin Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Domain-Id: default Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Domain-Name: Default Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Id: b9ad904703784b73a4b1e6a16fa26389 Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: X-User-Name: admin Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: method: > Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: exception: Flavor 451 could not be found. Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: action_args: {'id': '451'} Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:50:48.844170 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:48.845034 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.846080 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-cbd8afed-905e-4345-9c75-44c5a62778ec admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:50:48.847163 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-cbd8afed-905e-4345-9c75-44c5a62778ec admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.590447 Aug 22 15:50:48.847163 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 22 15:50:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 592 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 15:50:48.855032 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-c22f3a9f-1c0d-44ea-90f5-d952e252b835 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:48.871889 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-c22f3a9f-1c0d-44ea-90f5-d952e252b835 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020618 Aug 22 15:50:48.872516 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 22 15:50:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:50:48.888116 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:48.917418 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035980 Aug 22 15:50:48.918330 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Aug 22 15:50:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:50:48.936030 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-c29ef166-2a54-4514-877f-dd83afc08ef5 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:48.946763 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.wsgi [None req-c29ef166-2a54-4514-877f-dd83afc08ef5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-c29ef166-2a54-4514-877f-dd83afc08ef5 admin admin] Request method failure captured: Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Accept: application/json Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Accept-Encoding: gzip, deflate Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Connection: keep-alive Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Content-Length: 0 Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Host: 10.222.0.40 Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Openstack-Api-Version: compute 2.90 Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Openstack-System-Scope: None Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: User-Agent: python-novaclient Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Auth-Token: gAAAAABjA6XXU_AsnAFiEZLkTNqb_EwN-MsjZD79Shv0tbSkMjPh7eAOQR0Pni2Z8ub-EQEyJxiu9qOG-s7B6XCxq7fU0x8zU3pwjRo5hXOsrppQ7nnQo44QlJNbN82kMHZalTfAJ7LV5dDvaV9nnPm8xsD8CzKaj7N9i9WYNbklJSIjbpzovoE Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Domain-Id: None Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Domain-Name: None Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Identity-Status: Confirmed Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Is-Admin-Project: True Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Domain-Id: default Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Domain-Name: Default Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Project-Name: admin Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Role: reader,admin,member Aug 22 15:50:48.950174 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Roles: reader,admin,member Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3494c700c71b4f21bf6902173eefb916", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3494c700c71b4f21bf6902173eefb916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3494c700c71b4f21bf6902173eefb916"}]}] Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant: admin Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant-Id: 3494c700c71b4f21bf6902173eefb916 Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-Tenant-Name: admin Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User: admin Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Domain-Id: default Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Domain-Name: Default Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Id: b9ad904703784b73a4b1e6a16fa26389 Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: X-User-Name: admin Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: method: > Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: exception: Flavor 451 could not be found. Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: action_args: {'id': '451'} Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:50:48.951850 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:48.952877 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: ERROR nova.api.openstack.wsgi Aug 22 15:50:48.954120 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-c29ef166-2a54-4514-877f-dd83afc08ef5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:50:48.955121 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-c29ef166-2a54-4514-877f-dd83afc08ef5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.024806 Aug 22 15:50:48.955121 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 22 15:50:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:50.386423 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:50.388025 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Aug 22 15:50:50.388594 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:50:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:51.067083 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-67b9ba82-fe14-47f9-9d53-fe2aae201414 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:51.095278 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-67b9ba82-fe14-47f9-9d53-fe2aae201414 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.548579 Aug 22 15:50:51.096439 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Aug 22 15:50:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 15:50:52.152243 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:52.153371 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001849 Aug 22 15:50:52.153856 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:52.773446 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-84a01131-7de3-43f0-998a-b2e37a1f7f72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:52.794768 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-84a01131-7de3-43f0-998a-b2e37a1f7f72 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.494865 Aug 22 15:50:52.795603 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Aug 22 15:50:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:53.873925 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:53.874947 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Aug 22 15:50:53.875370 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:50:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:54.460387 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-0f4ef3d0-4e7d-4706-818f-b47bdcba4c15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:54.482283 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-0f4ef3d0-4e7d-4706-818f-b47bdcba4c15 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.463697 Aug 22 15:50:54.482844 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Aug 22 15:50:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:55.566438 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:55.567575 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 22 15:50:55.568031 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:56.166091 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-53b90fe0-6cf2-416b-8760-ce06c2ecd6af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:50:56.186722 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-53b90fe0-6cf2-416b-8760-ce06c2ecd6af admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.479134 Aug 22 15:50:56.188069 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Aug 22 15:50:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:57.439873 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:57.440880 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 22 15:50:57.441284 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:50:58.173993 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-0d2938f2-f06a-43c6-b3df-1dc1d743e62a admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:50:58.196679 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-0d2938f2-f06a-43c6-b3df-1dc1d743e62a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.609134 Aug 22 15:50:58.197294 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Mon Aug 22 15:50:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:51:55.425036 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:51:55.426061 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-d50366f1-0d90-4b3e-b8db-ad5e230e2c72 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 22 15:51:55.426491 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Mon Aug 22 15:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:51:55.437698 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:55.865726 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-85503c96-15ed-4744-8b49-5a2a2d637232 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:51:55.886747 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-85503c96-15ed-4744-8b49-5a2a2d637232 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.454063 Aug 22 15:51:55.887308 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Mon Aug 22 15:51:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:51:55.909927 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG dbcounter [-] [105541] Writing DB stats nova_api:SELECT=14 {{(pid=105541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:55.914553 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-ba68b52f-8633-4525-8a81-defb3c694834 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:51:55.923516 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-ba68b52f-8633-4525-8a81-defb3c694834 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014972 Aug 22 15:51:55.924091 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Mon Aug 22 15:51:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:51:55.937564 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-08119c3f-d786-4466-83b2-f3554e4b5093 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:51:55.945866 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-08119c3f-d786-4466-83b2-f3554e4b5093 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012523 Aug 22 15:51:55.946456 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Mon Aug 22 15:51:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:51:55.960374 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:51:55.969312 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012959 Aug 22 15:51:55.969944 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Mon Aug 22 15:51:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:51:55.982687 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-d82f5455-0d28-48ef-bcbf-95b0825bcc35 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:51:55.991299 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-d82f5455-0d28-48ef-bcbf-95b0825bcc35 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012188 Aug 22 15:51:55.991928 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Mon Aug 22 15:51:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:56:56.101826 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:56:56.102874 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 22 15:56:56.103273 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:56:56.243852 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_api:SELECT=6 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:56.413219 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-1a5b2bed-9006-4984-a83a-f924f2ac94e1 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:56:56.415539 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:56:56.415539 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: warnings.warn(msg) Aug 22 15:56:56.416680 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-1a5b2bed-9006-4984-a83a-f924f2ac94e1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:56:56.417153 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-1a5b2bed-9006-4984-a83a-f924f2ac94e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:56:56.417580 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-1a5b2bed-9006-4984-a83a-f924f2ac94e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:56:56.418356 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-1a5b2bed-9006-4984-a83a-f924f2ac94e1 admin admin] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:56:56.418805 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-1a5b2bed-9006-4984-a83a-f924f2ac94e1 admin admin] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:56:56.419222 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-1a5b2bed-9006-4984-a83a-f924f2ac94e1 admin admin] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:56:56.452672 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-1a5b2bed-9006-4984-a83a-f924f2ac94e1 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210335 Aug 22 15:56:56.453238 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 22 15:56:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:56:57.283423 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:56:57.284449 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 22 15:56:57.284852 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:56:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:56:57.483320 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-bb69fecf-779e-432b-a578-ee59d40129e6 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:56:57.485693 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:56:57.485693 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: warnings.warn(msg) Aug 22 15:56:57.486834 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-bb69fecf-779e-432b-a578-ee59d40129e6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:56:57.487366 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-bb69fecf-779e-432b-a578-ee59d40129e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:56:57.487806 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-bb69fecf-779e-432b-a578-ee59d40129e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:56:57.488534 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-bb69fecf-779e-432b-a578-ee59d40129e6 admin admin] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:56:57.488989 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-bb69fecf-779e-432b-a578-ee59d40129e6 admin admin] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:56:57.489485 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-bb69fecf-779e-432b-a578-ee59d40129e6 admin admin] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:56:57.509542 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-bb69fecf-779e-432b-a578-ee59d40129e6 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080983 Aug 22 15:56:57.510051 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 22 15:56:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 15:57:08.793734 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:57:08.794680 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 22 15:57:08.795074 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:57:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:57:08.937304 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_cell0:SELECT=4 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:08.938052 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_cell1:SELECT=4 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:08.938665 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG dbcounter [-] [105542] Writing DB stats nova_api:SELECT=8 {{(pid=105542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:08.989502 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-08e70bdd-3f41-4cae-9492-087e4e0bde5a admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:57:08.991995 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:08.991995 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: warnings.warn(msg) Aug 22 15:57:08.993138 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-08e70bdd-3f41-4cae-9492-087e4e0bde5a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:57:08.993622 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-08e70bdd-3f41-4cae-9492-087e4e0bde5a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:57:08.994058 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-08e70bdd-3f41-4cae-9492-087e4e0bde5a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:57:08.994791 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-08e70bdd-3f41-4cae-9492-087e4e0bde5a admin admin] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:57:08.995246 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-08e70bdd-3f41-4cae-9492-087e4e0bde5a admin admin] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:57:08.995703 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-08e70bdd-3f41-4cae-9492-087e4e0bde5a admin admin] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:57:09.021537 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-08e70bdd-3f41-4cae-9492-087e4e0bde5a admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088597 Aug 22 15:57:09.022677 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 22 15:57:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:57:09.844476 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: DEBUG nova.api.openstack.wsgi [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] Calling method '>' {{(pid=105541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:57:09.845489 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: INFO nova.api.openstack.requestlog [None req-2ae9e7ef-bb80-4050-9245-0aea830c68f5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 22 15:57:09.845893 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: [pid: 105541|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Aug 22 15:57:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:57:10.039461 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG nova.api.openstack.wsgi [None req-abfac8eb-d216-4444-aad1-41194c1339b1 admin admin] Calling method '>' {{(pid=105542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:57:10.041887 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:10.041887 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: warnings.warn(msg) Aug 22 15:57:10.043146 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-abfac8eb-d216-4444-aad1-41194c1339b1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:57:10.043661 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-abfac8eb-d216-4444-aad1-41194c1339b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:57:10.044099 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-abfac8eb-d216-4444-aad1-41194c1339b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:57:10.044830 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-abfac8eb-d216-4444-aad1-41194c1339b1 admin admin] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:57:10.045284 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-abfac8eb-d216-4444-aad1-41194c1339b1 admin admin] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:57:10.045709 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: DEBUG oslo_concurrency.lockutils [None req-abfac8eb-d216-4444-aad1-41194c1339b1 admin admin] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:57:10.068141 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: INFO nova.api.openstack.requestlog [None req-abfac8eb-d216-4444-aad1-41194c1339b1 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084235 Aug 22 15:57:10.068787 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: [pid: 105542|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Aug 22 15:57:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:58:07.959525 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: Mon Aug 22 15:58:07 2022 - graceful shutdown triggered... Aug 22 15:58:07.959665 dv-cinder-854004-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 22 15:58:07.960662 dv-cinder-854004-1-iscsi devstack@n-api.service[105541]: Gracefully killing worker 1 (pid: 105541)... Aug 22 15:58:07.961065 dv-cinder-854004-1-iscsi devstack@n-api.service[105542]: Gracefully killing worker 2 (pid: 105542)... Aug 22 15:58:08.961773 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: worker 1 buried after 1 seconds Aug 22 15:58:08.962346 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: worker 2 buried after 1 seconds Aug 22 15:58:08.962346 dv-cinder-854004-1-iscsi devstack@n-api.service[105540]: goodbye to uWSGI. Aug 22 15:58:08.963314 dv-cinder-854004-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 22 15:58:08.963884 dv-cinder-854004-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 22 15:58:08.966907 dv-cinder-854004-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 15:58:08.976215 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 15:58:08.978840 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 15:58:08 2022] *** Aug 22 15:58:08.978986 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: nodename: dv-cinder-854004-1-iscsi Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: machine: x86_64 Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: clock source: unix Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: pcre jit disabled Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: detected number of CPU cores: 4 Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: current working directory: / Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: detected binary path: /usr/bin/uwsgi-core Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: your processes number limit is 47680 Aug 22 15:58:08.979122 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: your memory page size is 4096 bytes Aug 22 15:58:08.979810 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: detected max file descriptor number: 2048 Aug 22 15:58:08.979810 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: lock engine: pthread robust mutexes Aug 22 15:58:08.979810 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: thunder lock: enabled Aug 22 15:58:08.979810 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 15:58:08.979810 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 15:58:09.018707 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: Python main interpreter initialized at 0x558c7b0099c0 Aug 22 15:58:09.018707 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: python threads support enabled Aug 22 15:58:09.018707 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: your server socket listen backlog is limited to 100 connections Aug 22 15:58:09.018707 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: your mercy for graceful operations on workers is 90 seconds Aug 22 15:58:09.019177 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 15:58:09.019177 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: *** Operational MODE: preforking *** Aug 22 15:58:09.019434 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: *** uWSGI is running in multiple interpreter mode *** Aug 22 15:58:09.019434 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: spawned uWSGI master process (pid: 121069) Aug 22 15:58:09.019634 dv-cinder-854004-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 15:58:09.020209 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: spawned uWSGI worker 1 (pid: 121079, cores: 1) Aug 22 15:58:09.020746 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: spawned uWSGI worker 2 (pid: 121080, cores: 1) Aug 22 15:58:09.021125 dv-cinder-854004-1-iscsi devstack@n-api.service[121069]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 15:58:09.696663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 15:58:09.698976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 15:58:10.855439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:58:10.855439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: from cryptography.utils import int_from_bytes Aug 22 15:58:10.856204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:58:10.856204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: from cryptography.utils import int_from_bytes Aug 22 15:58:10.860738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:58:10.860738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: from cryptography.utils import int_from_bytes Aug 22 15:58:10.861197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:58:10.861197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: from cryptography.utils import int_from_bytes Aug 22 15:58:13.321615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 15:58:13.322223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 15:58:13.322475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 15:58:13.322805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 15:58:13.323057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 15:58:13.323555 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.323888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.324213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.324531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.325073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.325430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.326056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.326056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.326399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.326712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.326984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.327399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854004-1-iscsi {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.327679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.327989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.328323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.328671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.328978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.329300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.329622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.330270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.330577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.330884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.331198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.331716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.332131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.332240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.332524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.332948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.333166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.334322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.334700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854004-1-iscsi {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.335025 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.335389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.335676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.336103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.336372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 15:58:13.336857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.336942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 15:58:13.337019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.337019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.337430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 15:58:13.337792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.337928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 15:58:13.338058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.338192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 15:58:13.338334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.338542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.338643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.338873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.339124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.339239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.339418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.339529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.339628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.339628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.339843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.339950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.340632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.340739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.340839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.340942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.341080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.341315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.341417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.341514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.341622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.341711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.342136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.342234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.342376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854004-1-iscsi {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.343256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.345343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.345800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.345800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.346591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.346879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.347066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.347228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.347441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.347698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.347966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.348224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.348472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.348767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.349022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.349259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.349259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.351309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.351660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.351923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.352186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.352441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.352714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.352888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.353050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.353707 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.353891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.354051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.354313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.354478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.354635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.354810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.354978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.355156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.355387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.355600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.355783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.355940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854004-1-iscsi {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.356825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.357086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.357227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.357391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.357553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.357685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.357864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.358023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.358146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.358274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.358399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.358504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.358684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.358788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.361728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.361728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.362010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.362173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.362430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.362624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.362861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.363095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.363268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.363531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.363719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.363886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.364036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.364177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.364315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.364494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.364648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.364781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.364929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.365075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.365215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.365357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.365520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.365687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.365892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.366048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.366260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.366418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.366560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.366718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.366861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.367017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.367172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.367314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.367496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.367670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.367828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.367984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.368139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.368255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.368412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.368563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.368663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.368773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.368883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.368979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369895 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.369982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.370067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.370151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.370151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.370476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.370734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.370900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.370900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.371174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.371311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.371560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.371730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.371730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.371730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.372161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.372307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.372483 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.372644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.372809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.372972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.373132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.373484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.373669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.373901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.374061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.374220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.374450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.374627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.374796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.374950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.374950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.375252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.375458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.375618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.375827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.376001 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.376170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.376340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.376490 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.376654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.376804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.376957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.377404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.377553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.377687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.377841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.377841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.378122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.378122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.378400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.378400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.378683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.378886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.379154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.379442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.379696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.379968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.380778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.381044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.381303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.381541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.381800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.382056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.382295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.382537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.382786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.383027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.383272 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.383717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.383979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.384245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.384523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.384523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.385007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.385253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.385429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.385598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.385815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.385985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.386165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.386336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.386508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.386665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.386818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.386976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.387151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.387308 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.387560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.387802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.388035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.388265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.388520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.388791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.389018 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.389251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.389402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.389536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.389678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.389818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.389818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.390171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.390399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.390623 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.390830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.391044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.391276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.391589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.391805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.392041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.392244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.392455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.392455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.392908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.393138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.393382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.393382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.393382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.393382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.394380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.394610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.394797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.394964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.395147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.395412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.395586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.395797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.396446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.396594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.396748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.396894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.397052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.397207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.397353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.397498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.397643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.397810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.397810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.398103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.398259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.398405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.398550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.398704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.398858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.399278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:58:13.399761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.399937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.401746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.402307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.402453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.402453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.402453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.402871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.403025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.403025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.403318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.403504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.403504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.403504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.403956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.404228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.404228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.404524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.404678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.404678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.404678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.405110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.405262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.405262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.405262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.405262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.405262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.405262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.405262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.406245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.406409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.406409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.406900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.407507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.408612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.408612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.408612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.408612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.409165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.409320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.409320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.409606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.409765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.409765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.410040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.410194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.410194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.410492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.410748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.410748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.411053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.411209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.411209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.411209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.411209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.411209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.411209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.412144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.412291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.412291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.412574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.412728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.412728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.413022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.413174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.413174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.413174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.413590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.413749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.413749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.414035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.414206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.414206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.414594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.414751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.414751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.415042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.415188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.415188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.415519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.415668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.415813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.415966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.415966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.416248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.416407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.416407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.416690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.416843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.416843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.417118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.417289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.417289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.417582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.417728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.417728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.418017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.418171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.418171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.418171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.418171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.418171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.418171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.418171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.419171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.419316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.419316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.419673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.419835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.419835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.420126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.420281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.420427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.420580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.420580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.420865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.421029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.421029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.421029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.421458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.421617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.421617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.421893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.422037 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.422181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.422408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.422408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.422684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.422852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.422852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.423171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.423347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.423347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.423347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.423784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.423935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.423935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.424233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.424385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.424385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.424840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.425007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.425007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.425317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.425465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.425465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.425830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.425974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.426373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.426598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.426761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.426937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.427257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.427583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.427748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.427905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.428051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.428241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.428534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.428685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.428939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.429092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.429262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.429625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.429789 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.429945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.430254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.430429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.430577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.430849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.431048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.431274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.431469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.431652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.431986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.432145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.432293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.432619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.432773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.433034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.433261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.433571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.433728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.433890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.434172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.434325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.434512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.434839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.435009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.435166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.435496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.435873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.436172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.436358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.436777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.436777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.437067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.437212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.437441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.437673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.437848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.438097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.438249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.438416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.438732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.438892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.439060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.439408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.439580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.439737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.440026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.440185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.440340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.440666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.440828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.440982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.441297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.441448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.441630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.441963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.442159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.442316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.443136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.443306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.443494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.443769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.443935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.444112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.444393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.444560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.444745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.445070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.445226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.445382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.446123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.446443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.446939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.447103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.447103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.447422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.447587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.447745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.447890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.448044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.448211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.448461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.448625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.449088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.449244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.449454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.449783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.449952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.450142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.450350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.450504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.450823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.450978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.451144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.451471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.451641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.451832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.452151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.452317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.452464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.452773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.452932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.453078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.453398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.453550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.453704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.454016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.454177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.454324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.454636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.454795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.454942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.455248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.455462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.455619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.455938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.456214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.456494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.456669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.456945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.457222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.457383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.457532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.457762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.457925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.458079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.459193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.459389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.459543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.459880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.460092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.460261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.460534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.460696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.460876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.461142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.461295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.461538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.461753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.461907 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.462187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.462346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.462493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.462810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.462978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.463126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.463459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.463617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.463775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.464082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.464245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.464401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.464712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.464866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.465021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.465343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.465513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.465675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.466146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.466319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.466465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.466752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.466926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.467394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.467560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.467724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.467881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.468027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.468173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.468456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.468609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.468777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.469090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.469287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.469449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.469715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.469879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.470026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.470327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.470480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.470635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.470951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.471124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.471273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.471618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.471772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.471927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.472248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.472410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.472571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.472867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.473019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.473173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.473482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.481585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.482819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.482819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.482819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.482819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.482819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.482819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.482819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.482819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.483976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.483976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.486788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.486957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.486957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.487259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.487471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.487471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.487853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.488012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.488012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.488314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.488496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.488496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.488795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.488951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.488951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.489246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.489448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.489448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.489796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.489987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.489987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.490291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.490458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.490458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.490757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.490921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.490921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.491758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.492273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.492273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.492588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.492742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.492989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.493171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.493171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.493479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.493632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.493632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.493632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.494224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.494387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.494387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.494732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.494885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.494885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.494885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.494885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.495612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.495838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.495838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.496236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.496405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.496405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.496621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.496734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.496734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.496734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.497250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.497250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.497250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.497945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.498174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.498412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.498412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.498719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.498872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.499033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.499259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.499259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.499846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.500051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.500051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.500051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.500051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.500051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.501023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.501023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.502199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.506775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.507062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.507062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.507472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.507679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.507843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.508848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.510203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.510203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.510203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.510677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.510863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.511028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.511197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.511597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.511768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.512122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.512515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.512782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.513012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.513180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.513344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.513504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.513657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.513853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.514014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.514175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.514508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.514852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.515196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.515518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.515697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.515875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.516031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.516198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.516421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.516603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.517423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.517593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.517759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.517913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.518073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.518233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.518454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.518617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.518617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.518943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.519096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.519096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.519911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.520093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.520283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.520441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.520594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.520817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.520817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.521683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.521848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.521848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.521848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.522413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.522572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.522740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.522740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.523029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.523181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.523363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.523531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.523695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.523857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.524089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.524262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.524415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.524731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.524976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.525139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.525360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.525582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.525751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.525954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.526129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.526339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.526536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.527090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.527634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.527978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.528309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.528637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.528961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.529328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.529652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.529897 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.530056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.530331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.530499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.530662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.530990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.531378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.531554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.531718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.532270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.532924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.533106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.533319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.533946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.538412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.538412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.538900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.539130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.539130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.539130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.539790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.539992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.540152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.540316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.540316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.540620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.540779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.540779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.541112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.541287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.541455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.541608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.541769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.542826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.542826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.542826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.542826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.542826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.542826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.542826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.542826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.544497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.544497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.544497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.544497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.544497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.545276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.545443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.545597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.545757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.545917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.546080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.546239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.546403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.546564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.546737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.546897 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.547063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.547216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.547424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.547592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.547761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.547914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.548083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.548236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.548545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.548698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.548871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.549024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.549183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.549335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.549527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.549683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.549886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.550040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.550242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.550359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.550479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.550593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.550716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.550986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.551221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.551438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.551438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.551973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.552683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.553148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.553496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.553823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.553983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.554148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.554332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.554499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.554750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.554750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.554750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.555305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.555305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.555663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.555818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.555991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.556149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.556310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.556471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.556635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.556796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.556962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.556962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.557298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.557453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.557641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.557840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.557998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.558159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.558321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.558481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.558657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.558819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.558971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.559140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.559354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.559515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.559680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.559680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.559680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.560122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.560277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.560277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.560277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.560732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.560886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.561037 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.561196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.561392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.561632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.561875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.562034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.562186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.562346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.562508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.562508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.562818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.562818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.563415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.563729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.563897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.564060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.564222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.564222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.564522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.564522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.564821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.564981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.565134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.565298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.565494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.565661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.565860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.566048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.566209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.566361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.566512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.566672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.566839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.566992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.567151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.567303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.567497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.567688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.567859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.568013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.568172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.568325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.568484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.568651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.568812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.568964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.569124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.569283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.569283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.569631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.569792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.569953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.570166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.570423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.570591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.570756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.570917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.571078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.571232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.571463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.571623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.571788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.571963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.572124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.572276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.572428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.572594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.572755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.572755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.573045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.573224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.573631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.574008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.574169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.574343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.574497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.574657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.574657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.574970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.574970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.575276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.575454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.575608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.575759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.575924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.576086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.576237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.576399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.576560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.576722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.576874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.577034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.577195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.577355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.577515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.577714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.577873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.578032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.578234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.578388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.578553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.578784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.578958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.579112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.579274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.579463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.579626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.579788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.579942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.580101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.580255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.580416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.580578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.580741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.580894 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.581045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.581205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.581205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.581524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.581687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.581848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.582105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.582265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.582419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.582586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.582752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.582972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.583139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.583139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.584164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.584341 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.584497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.584650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.584801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.584961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.585128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.585128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.585418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.585589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.585589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.585941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.586105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.586306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.586468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.586628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.586628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.586924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.586924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.586924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.587505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.587667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.587833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.587985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.588147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.588300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.588451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.588605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.588757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.588918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.589070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.589070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.589358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.589526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.589691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.589858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.590019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.590210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.590210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.590522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.590675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.590934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.591095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.591257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.591455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.591611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.591766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.591945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.592305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.592475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.592637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.592793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.592956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.593118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.593273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.593443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.593598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.594022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.594621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.594812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.594969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.595243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.595457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.595616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.595782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.595937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.596105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.596260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.596413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.596704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.596861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.597016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.597188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.597342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.597495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.597663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.597663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.597954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.598110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.598303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.598484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.598653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.599390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.599570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.599737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.599904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.600071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.600234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.600522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.600682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.600835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.600988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.601156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.601318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.601318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.601736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.601897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.602100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.602276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.602577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.602737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.602899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.603052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.603205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.603397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.604458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.604780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.604953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.605120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.605274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.605429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.605581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.605745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.605906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.606059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.606213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.606373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.606528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.606689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.606851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.607013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.607185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.607366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.607542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.607696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.607848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.607999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.608151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.608316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.608522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.608682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.608835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.608989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.608989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.609289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.609451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.609451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.609751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.609904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.610056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.610056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.610056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.610555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.610709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.610870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.611031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.611209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.611443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.611616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.611779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.611932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.612093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.612261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.612422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.612702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.612863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.613015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.613180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.613352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.613527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.613696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.613696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.613988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.614173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.615169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.615503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.615665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.615828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.615982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.616154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.616309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.616472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.616639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.616800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.616962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.616962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.617269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.617269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.617566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.617729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.617889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.618057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.618210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.618210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.618530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.618740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.618904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.619060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.619212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.619400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.619560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.619724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.619888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.620043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.620195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.620347 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.620508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.620680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.620845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.620845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.621136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.621288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.621441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.621592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.622486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.622686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.622949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.623109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.623109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.623477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.623656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.623820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.623984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.624138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.624335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.624956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.625975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.626288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.626373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.626457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.626544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.626544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.626714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.626940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.627127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.627297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.627513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.627796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.627964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.628121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.628292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.628444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.628610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.628764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.628932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.629087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.629241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.629392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.629571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.629730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.629841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.629927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.630181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.630291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.630520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.630740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.630962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.631169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.631169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.631647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.631844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.632046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.632233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 15:58:13.632442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.632652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.633139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.633556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.633990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.634380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.634726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.635128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.635565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.636058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.636382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.636719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.637052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.637390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.637716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.638039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.638376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.638691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.639005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.640902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.640902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.640902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.640902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.640902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.640902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.641659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.641659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.642192 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.642552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.642900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.643239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.643622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.643960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.644260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.644596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.644914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.645304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.646212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.646524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.646844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.647158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.647579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.647947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.648274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.648597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.648908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.649245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.649557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.649869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.650181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.650499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.650817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.651128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.651468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.651779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.652096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.652409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.652724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.653129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.653497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.653813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.654132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.654445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.654794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.655301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.655564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.655895 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.656230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.656543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.656866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.657184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.657542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.659453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.659453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.659453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.659453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.659453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.660062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.660141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.660387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.660696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.661031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.662032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.662302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.662629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.662942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.663281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.663703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.664052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.664373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.664692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.665011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.665329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.665647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.665965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.666282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.666610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.666975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.667303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.667656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.667966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.668294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.668610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.668955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.669272 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.669588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.669912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.670250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.670571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.670884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.671321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.671659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.671991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.672319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.672639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.672969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.673302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.673621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.673952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.674274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.674609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.675023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.675296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.675944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.676198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.676452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.676692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.676980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.677276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.677596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.677906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.678218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.678539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.678849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.679163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.679499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.679811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.680129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.680438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.680748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.681060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.681371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.681682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.681987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.682308 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.682615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.682925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.683239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.683574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.683886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.684332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.684671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.684997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.685333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.685653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.685983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.686349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.686617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.686945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.687271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.687616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.687960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.688280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.688923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.689249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.689574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.689896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.690250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.690590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.690928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.691242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.691602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.691926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.692256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.692612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.692933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.693312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.693637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.693956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.694275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.694594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.694914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.695236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.695579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.695903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.696223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.696548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.696887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.697215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.697535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.697868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.698059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO dbcounter [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Registered counter for database nova_api Aug 22 15:58:13.698242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.698550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.699029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.699209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.699574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.699897 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.700215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.700525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:58:13.700774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 15:58:13.720818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_db.sqlalchemy.engines [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:58:13.728827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writer thread running {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:58:13.764013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO dbcounter [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Registered counter for database nova_api Aug 22 15:58:13.787432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:58:13.789587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.context [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9b6efaf-c661-4a43-9954-830521140ee8(cell1) {{(pid=121079) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 15:58:13.794074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:58:13.794563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:58:13.795178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writer thread running {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:58:13.796214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:58:13.797010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:58:13.797469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:58:13.799585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:58:13.802029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO dbcounter [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Registered counter for database nova_cell0 Aug 22 15:58:13.806729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO dbcounter [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Registered counter for database nova_cell1 Aug 22 15:58:13.816005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_db.sqlalchemy.engines [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:58:13.816831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_db.sqlalchemy.engines [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:58:13.824425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writer thread running {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:58:13.826088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writer thread running {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:58:13.853927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.context [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9b6efaf-c661-4a43-9954-830521140ee8(cell1) {{(pid=121080) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 15:58:13.858235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:58:13.858721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:58:13.860357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:58:13.861226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:58:13.861683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:58:13.863834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:58:13.866582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO dbcounter [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Registered counter for database nova_cell0 Aug 22 15:58:13.871268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO dbcounter [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Registered counter for database nova_cell1 Aug 22 15:58:13.884031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:58:13.884956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:58:13.892183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writer thread running {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:58:13.893588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writer thread running {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:58:13.987273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO dbcounter [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Registered counter for database nova_cell0 Aug 22 15:58:13.996702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_db.sqlalchemy.engines [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:58:14.002264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writer thread running {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:58:14.047771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO dbcounter [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Registered counter for database nova_cell0 Aug 22 15:58:14.060824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:58:14.067670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writer thread running {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:58:14.344403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: WARNING keystonemiddleware.auth_token [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 15:58:14.352716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: WARNING keystonemiddleware.auth_token [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 15:58:14.430561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: WARNING keystonemiddleware.auth_token [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 15:58:14.439212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: WARNING keystonemiddleware.auth_token [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 15:58:14.734042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: WARNING keystonemiddleware.auth_token [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 15:58:14.741124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: WARNING keystonemiddleware.auth_token [None req-97c427f1-35d0-4208-a0ad-e4e882e0be84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 15:58:14.747218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558c7b0099c0 pid: 121079 (default app) Aug 22 15:58:14.790757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: WARNING keystonemiddleware.auth_token [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 15:58:14.796958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: WARNING keystonemiddleware.auth_token [None req-fc3fe1f2-b5a4-4d8b-831c-5d41bec376c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 15:58:14.802504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558c7b0099c0 pid: 121080 (default app) Aug 22 15:58:51.591834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:51.593619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:51.594743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:51.595784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:51.726611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:51.728206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:51.729302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:51.730309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:52.998871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-263b0ff3-549d-445a-bd56-c3d9d3ac6367 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Action: 'create', calling method: .version_select at 0x7fec9d9df5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-300988735", "metadata": {"Type": "work"}}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:58:53.201903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1eef8362-4dbe-41c4-b630-a500010755c5 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Action: 'create', calling method: .version_select at 0x7fec9d9df700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1475639617"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:58:54.373203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-263b0ff3-549d-445a-bd56-c3d9d3ac6367 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.791978 Aug 22 15:58:54.374752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Aug 22 15:58:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2795 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 15:58:54.390356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b1b67fb2-2d5f-4b3e-aa8d-16c9cabd5201 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Calling method '.version_select at 0x7fec9d8b64c0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:54.535664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1eef8362-4dbe-41c4-b630-a500010755c5 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.820917 Aug 22 15:58:54.537472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1/2] 10.222.0.40 () {60 vars in 1155 bytes} [Mon Aug 22 15:58:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2826 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 15:58:54.553039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b45131f8-ec1a-45fb-8a43-4e33d788abef tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8b5550>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:54.651730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b1b67fb2-2d5f-4b3e-aa8d-16c9cabd5201 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0" status: 200 len: 352 microversion: 2.1 time: 0.266808 Aug 22 15:58:54.652457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:58:54 2022] GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0 => generated 352 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:58:54.812776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b45131f8-ec1a-45fb-8a43-4e33d788abef tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6" status: 200 len: 345 microversion: 2.1 time: 0.264832 Aug 22 15:58:54.813887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:58:54 2022] GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 => generated 345 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:58:55.665498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aba9a31b-bfc6-4703-8ef8-8be9a01b5b51 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Calling method '.version_select at 0x7fec9d8b6b80>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:55.798854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aba9a31b-bfc6-4703-8ef8-8be9a01b5b51 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0" status: 200 len: 353 microversion: 2.1 time: 0.136992 Aug 22 15:58:55.799461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:58:55 2022] GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:58:55.812238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-80069b4a-9009-42fa-84d8-46ea1a69b325 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Calling method '.version_select at 0x7fec9d8b5c10>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:55.828871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-43310c5c-75e6-4a93-9200-8b9f5cad895b tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8c8280>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:55.903871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-80069b4a-9009-42fa-84d8-46ea1a69b325 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0" status: 200 len: 353 microversion: 2.1 time: 0.095377 Aug 22 15:58:55.904790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:58:55 2022] GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:58:55.917591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b5785876-522b-4477-a36e-25a708da098e tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Calling method '.version_select at 0x7fec9d8cd3a0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:55.978653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-43310c5c-75e6-4a93-9200-8b9f5cad895b tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6" status: 200 len: 346 microversion: 2.1 time: 0.156473 Aug 22 15:58:55.980118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:58:55 2022] GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 => generated 346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:58:55.993572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0e7c61ea-5f10-40f1-ab13-993cb2ec344e tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Action: 'create', calling method: .version_select at 0x7fec9d8b6c10>, body: {"snapshot": {"volume_id": "8f48e71f-8c77-4ecb-8690-ecda8ede14d6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-147054512"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:58:56.047741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b5785876-522b-4477-a36e-25a708da098e tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0" status: 202 len: 0 microversion: 2.1 time: 0.133849 Aug 22 15:58:56.048637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 15:58:55 2022] DELETE /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 15:58:56.058769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ea6259ad-83bf-479f-a1d3-1ed6e98dc79b tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Calling method '.version_select at 0x7fec9d8b5c10>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:56.160751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ea6259ad-83bf-479f-a1d3-1ed6e98dc79b tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0" status: 200 len: 352 microversion: 2.1 time: 0.105634 Aug 22 15:58:56.168363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:58:56 2022] GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:58:56.360740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0e7c61ea-5f10-40f1-ab13-993cb2ec344e tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.371446 Aug 22 15:58:56.362977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 5/10] 10.222.0.40 () {60 vars in 1162 bytes} [Mon Aug 22 15:58:55 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:58:56.383120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ebb26d82-4db4-4488-a8d5-d646458626d7 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8b5550>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:56.541153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ebb26d82-4db4-4488-a8d5-d646458626d7 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 200 len: 286 microversion: 2.1 time: 0.169023 Aug 22 15:58:56.541370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:58:56 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:58:56.553429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-432dd62a-59d5-4221-93d4-bf33d97597b8 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8c8040>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:56.665581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-432dd62a-59d5-4221-93d4-bf33d97597b8 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.116784 Aug 22 15:58:56.673980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1140 bytes} [Mon Aug 22 15:58:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:58:56.680976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fbdb41bb-271b-4021-872c-2471afddd2d2 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8cd430>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:56.772726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fbdb41bb-271b-4021-872c-2471afddd2d2 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 200 len: 286 microversion: 2.1 time: 0.097189 Aug 22 15:58:56.773530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:58:56 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:58:57.179175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3972d1d8-c0ce-4499-b6a2-bd8c950c27b1 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Calling method '.version_select at 0x7fec9d8c8ca0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:57.258203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-3972d1d8-c0ce-4499-b6a2-bd8c950c27b1 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] HTTP exception thrown: Volume 465cd299-445e-4fb5-8565-f839c7b2aee0 could not be found. Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3972d1d8-c0ce-4499-b6a2-bd8c950c27b1 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Request method failure captured: Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0 HTTP/1.1 Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6e70SAwyu7edyvebGegusSes8AfjFOrPvK3_Km32K2j27hgvIt7N7JvPIHcis57XyGpwmv8KKeXVrnvZ7siBVP-Q3jF-xckdFg7iB_tPX9_GPmz4piuMppazTcu6nW11omKQPCta38-VBHmfixy0n3GEpea52YK03Pxhr_ZOXohzCY Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 366cbdf989774649805974ba1972c334 Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesGetTestJSON-573098200 Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 15:58:57.265148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/366cbdf989774649805974ba1972c334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_366cbdf989774649805974ba1972c334", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/366cbdf989774649805974ba1972c334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/366cbdf989774649805974ba1972c334"}]}] Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesGetTestJSON-573098200 Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 366cbdf989774649805974ba1972c334 Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesGetTestJSON-573098200 Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesGetTestJSON-573098200-project Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 95ffe38ca7534358aa080ee1517afa9b Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesGetTestJSON-573098200-project Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Volume 465cd299-445e-4fb5-8565-f839c7b2aee0 could not be found. Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '465cd299-445e-4fb5-8565-f839c7b2aee0'} Aug 22 15:58:57.266572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 465cd299-445e-4fb5-8565-f839c7b2aee0 could not be found. (HTTP 404) (Request-ID: req-4770d787-483a-4ff7-aafc-4672838f905c) Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:58:57.267502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:58:57.268721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 465cd299-445e-4fb5-8565-f839c7b2aee0 could not be found. Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 15:58:57.269824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 465cd299-445e-4fb5-8565-f839c7b2aee0 could not be found. Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 465cd299-445e-4fb5-8565-f839c7b2aee0 could not be found. Aug 22 15:58:57.271232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:58:57.273548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3972d1d8-c0ce-4499-b6a2-bd8c950c27b1 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] Returning 404 to user: Volume 465cd299-445e-4fb5-8565-f839c7b2aee0 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:58:57.276453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3972d1d8-c0ce-4499-b6a2-bd8c950c27b1 tempest-VolumesGetTestJSON-573098200 tempest-VolumesGetTestJSON-573098200-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0" status: 404 len: 109 microversion: 2.1 time: 0.102660 Aug 22 15:58:57.277024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 7/14] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:58:57 2022] GET /compute/v2.1/os-volumes/465cd299-445e-4fb5-8565-f839c7b2aee0 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 15:58:57.786544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2c375f9e-e7b7-4e78-850a-2277a55890f4 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8b54c0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:58.054004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2c375f9e-e7b7-4e78-850a-2277a55890f4 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 200 len: 286 microversion: 2.1 time: 0.272019 Aug 22 15:58:58.055064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:58:57 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 286 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:58:59.067211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-04185f22-7455-44d1-bdac-faa85d0f2022 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9e28cb80>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:58:59.142443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-04185f22-7455-44d1-bdac-faa85d0f2022 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 200 len: 286 microversion: 2.1 time: 0.079769 Aug 22 15:58:59.143202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:58:59 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:00.155692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae4a6e4b-fcd7-4f8e-81ae-39be6d825d53 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8b5b80>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:00.202116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ae4a6e4b-fcd7-4f8e-81ae-39be6d825d53 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 200 len: 287 microversion: 2.1 time: 0.050432 Aug 22 15:59:00.203719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 9/17] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:59:00 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:00.216615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-473a7e3a-1cf0-4183-bce8-8626376546f6 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8c8d30>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:00.385219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-473a7e3a-1cf0-4183-bce8-8626376546f6 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 202 len: 0 microversion: 2.1 time: 0.173447 Aug 22 15:59:00.390041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 9/18] 10.222.0.40 () {58 vars in 1254 bytes} [Mon Aug 22 15:59:00 2022] DELETE /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 15:59:00.399874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5b528214-ac59-49f7-8543-c6a5efdf4c9c tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8cd160>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:00.446627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5b528214-ac59-49f7-8543-c6a5efdf4c9c tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 200 len: 286 microversion: 2.1 time: 0.052334 Aug 22 15:59:00.447981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 10/19] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:59:00 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:01.461001 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e8bf4f7a-8cae-4928-965f-482f01476f7f tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8345e0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:01.559031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e8bf4f7a-8cae-4928-965f-482f01476f7f tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 200 len: 286 microversion: 2.1 time: 0.102767 Aug 22 15:59:01.559822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 10/20] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:59:01 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:02.540820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0954e9c6-a2cd-45b4-81ea-f3184bb4e19c tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Action: 'create', calling method: .version_select at 0x7fec9d834af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1342633749", "metadata": {"Type": "work"}}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0954e9c6-a2cd-45b4-81ea-f3184bb4e19c tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Request method failure captured: Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 122 Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fGjb14DKcVFlrlvHknhXQHLJyLnEP3bWmj8-WXNWPYsLaqTiC1szGEGPkx6bO6jd3yoY4tC9-RKhL86Waam3zQCKFacTkKajLWiEuKks9KZT-vErXlC4a64vDQvYv5UEWHN-ZTRL455GV76wvD4nX_CM1FXXKxi6pzDwosaoHlavw Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 15:59:02.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_012877366afd4a609c139faa9ec9dd8b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}] Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: fd0a0767387943549d7f2c3c7a71b5df Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1342633749", "metadata": {"Type": "work"}}} Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: Aug 22 15:59:02.549787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1342633749', 'metadata': {'Type': 'work'}}}} Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise error Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi '#$%' Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:02.550977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 15:59:02.552062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 15:59:02.552973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 15:59:02.552973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.552973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0954e9c6-a2cd-45b4-81ea-f3184bb4e19c tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:02.552973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0954e9c6-a2cd-45b4-81ea-f3184bb4e19c tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129202 Aug 22 15:59:02.564689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-63ac4a22-0f04-4cdc-8285-327a6f23e99e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: .version_select at 0x7fec9d8cda60>, body: {"keypair": {"name": "tempest-keypair-231912585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqsSZ8lAsHo69PHSl9HIyYecv+aq2BYiWDImh2vntz9axYdTvSRzsOOPDofaHhg3Zd2JVGGhbgvnUgwyfd+bY1EXUiX8VrJCRxfPO3wZQHqTziQJ6RyCP0FWrE8W+xWAQ=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:02.576201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 11/21] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Aug 22 15:59:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 15:59:02.618092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-daa65b79-1f2b-4564-a9cb-aaf0fbedc280 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Action: 'create', calling method: .version_select at 0x7fec9d8c8160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-218831549", "metadata": {"Type": "work"}}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-daa65b79-1f2b-4564-a9cb-aaf0fbedc280 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Request method failure captured: Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 119 Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fGjb14DKcVFlrlvHknhXQHLJyLnEP3bWmj8-WXNWPYsLaqTiC1szGEGPkx6bO6jd3yoY4tC9-RKhL86Waam3zQCKFacTkKajLWiEuKks9KZT-vErXlC4a64vDQvYv5UEWHN-ZTRL455GV76wvD4nX_CM1FXXKxi6pzDwosaoHlavw Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 15:59:02.632783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_012877366afd4a609c139faa9ec9dd8b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}] Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: fd0a0767387943549d7f2c3c7a71b5df Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-218831549", "metadata": {"Type": "work"}}} Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: Aug 22 15:59:02.633917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-218831549', 'metadata': {'Type': 'work'}}}} Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise error Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi '0' Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:02.634633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 15:59:02.636252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 15:59:02.637128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 15:59:02.637128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.639658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-daa65b79-1f2b-4564-a9cb-aaf0fbedc280 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:02.640624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-daa65b79-1f2b-4564-a9cb-aaf0fbedc280 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.062701 Aug 22 15:59:02.641261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 12/22] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Aug 22 15:59:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 15:59:02.662838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2ba8bdbf-befd-4cc5-b6f9-d6b27acd5309 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d83cf70>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:02.742893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-63ac4a22-0f04-4cdc-8285-327a6f23e99e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 15:59:02.750469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-63ac4a22-0f04-4cdc-8285-327a6f23e99e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for user 1b896f9378dc4188868734e05ddd39fb and project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 15:59:02.775825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2ba8bdbf-befd-4cc5-b6f9-d6b27acd5309 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 200 len: 286 microversion: 2.1 time: 0.117409 Aug 22 15:59:02.777137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 13/23] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:59:02 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:02.782888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1b3ed162-06a7-40c8-8281-049ccce32514 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Action: 'create', calling method: .version_select at 0x7fec9d7e45e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-248845033", "metadata": {"Type": "work"}}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1b3ed162-06a7-40c8-8281-049ccce32514 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Request method failure captured: Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 118 Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fGjb14DKcVFlrlvHknhXQHLJyLnEP3bWmj8-WXNWPYsLaqTiC1szGEGPkx6bO6jd3yoY4tC9-RKhL86Waam3zQCKFacTkKajLWiEuKks9KZT-vErXlC4a64vDQvYv5UEWHN-ZTRL455GV76wvD4nX_CM1FXXKxi6pzDwosaoHlavw Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 15:59:02.798587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_012877366afd4a609c139faa9ec9dd8b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}] Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: fd0a0767387943549d7f2c3c7a71b5df Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-248845033", "metadata": {"Type": "work"}}} Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: Aug 22 15:59:02.799727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-248845033', 'metadata': {'Type': 'work'}}}} Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise error Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi '' Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:02.800403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 15:59:02.801433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 15:59:02.802471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 15:59:02.802471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.802471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1b3ed162-06a7-40c8-8281-049ccce32514 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:02.803009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1b3ed162-06a7-40c8-8281-049ccce32514 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024631 Aug 22 15:59:02.804720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 14/24] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Aug 22 15:59:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 15:59:02.822177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16a6353e-d095-43f5-b96a-88353f0e5bd0 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Calling method '.version_select at 0x7fec9d8c8790>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:02.881631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-16a6353e-d095-43f5-b96a-88353f0e5bd0 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] HTTP exception thrown: Volume tempest-invalid-291931493 could not be found. Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16a6353e-d095-43f5-b96a-88353f0e5bd0 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Request method failure captured: Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-291931493 HTTP/1.1 Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fGjb14DKcVFlrlvHknhXQHLJyLnEP3bWmj8-WXNWPYsLaqTiC1szGEGPkx6bO6jd3yoY4tC9-RKhL86Waam3zQCKFacTkKajLWiEuKks9KZT-vErXlC4a64vDQvYv5UEWHN-ZTRL455GV76wvD4nX_CM1FXXKxi6pzDwosaoHlavw Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 15:59:02.883582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_012877366afd4a609c139faa9ec9dd8b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}] Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: fd0a0767387943549d7f2c3c7a71b5df Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Volume tempest-invalid-291931493 could not be found. Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': 'tempest-invalid-291931493'} Aug 22 15:59:02.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-291931493 could not be found. (HTTP 404) (Request-ID: req-7c3be66d-d663-443b-a52a-872659e0cf7c) Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.889736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 15:59:02.891481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-291931493 could not be found. Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:59:02.893301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-291931493 could not be found. Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-291931493 could not be found. Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16a6353e-d095-43f5-b96a-88353f0e5bd0 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Returning 404 to user: Volume tempest-invalid-291931493 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16a6353e-d095-43f5-b96a-88353f0e5bd0 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-291931493" status: 404 len: 98 microversion: 2.1 time: 0.069787 Aug 22 15:59:02.895933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 15/25] 10.222.0.40 () {58 vars in 1215 bytes} [Mon Aug 22 15:59:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-291931493 => generated 98 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 15:59:02.905317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b31d85e5-786f-4427-9143-f51a1f632385 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014412 Aug 22 15:59:02.905875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 16/26] 10.222.0.40 () {58 vars in 1140 bytes} [Mon Aug 22 15:59:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 15:59:02.915882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9f0c955b-3382-480e-970f-819ac1a439c8 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003831 Aug 22 15:59:02.916413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 17/27] 10.222.0.40 () {58 vars in 1137 bytes} [Mon Aug 22 15:59:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 15:59:02.926799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-776ab3d0-54d3-4f46-a2a1-1ef7a75415ba tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Calling method '.version_select at 0x7fec9d8c8ca0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:02.931983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-63ac4a22-0f04-4cdc-8285-327a6f23e99e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.825084 Aug 22 15:59:02.951201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 11/28] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 15:59:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:02.980934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-776ab3d0-54d3-4f46-a2a1-1ef7a75415ba tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] HTTP exception thrown: Volume 00f28cfa-538a-430a-8942-134f3e9e7359 could not be found. Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-776ab3d0-54d3-4f46-a2a1-1ef7a75415ba tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Request method failure captured: Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/os-volumes/00f28cfa-538a-430a-8942-134f3e9e7359 HTTP/1.1 Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fGjb14DKcVFlrlvHknhXQHLJyLnEP3bWmj8-WXNWPYsLaqTiC1szGEGPkx6bO6jd3yoY4tC9-RKhL86Waam3zQCKFacTkKajLWiEuKks9KZT-vErXlC4a64vDQvYv5UEWHN-ZTRL455GV76wvD4nX_CM1FXXKxi6pzDwosaoHlavw Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 15:59:02.982864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_012877366afd4a609c139faa9ec9dd8b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}] Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: fd0a0767387943549d7f2c3c7a71b5df Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Volume 00f28cfa-538a-430a-8942-134f3e9e7359 could not be found. Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '00f28cfa-538a-430a-8942-134f3e9e7359'} Aug 22 15:59:02.984584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 00f28cfa-538a-430a-8942-134f3e9e7359 could not be found. (HTTP 404) (Request-ID: req-5d476dc4-77bb-4e8a-8fd3-351547615fc8) Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.985402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 15:59:02.986531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 00f28cfa-538a-430a-8942-134f3e9e7359 could not be found. Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 15:59:02.988359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 00f28cfa-538a-430a-8942-134f3e9e7359 could not be found. Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 00f28cfa-538a-430a-8942-134f3e9e7359 could not be found. Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-776ab3d0-54d3-4f46-a2a1-1ef7a75415ba tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Returning 404 to user: Volume 00f28cfa-538a-430a-8942-134f3e9e7359 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-776ab3d0-54d3-4f46-a2a1-1ef7a75415ba tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/00f28cfa-538a-430a-8942-134f3e9e7359" status: 404 len: 109 microversion: 2.1 time: 0.061731 Aug 22 15:59:02.989721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 18/29] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 15:59:02 2022] DELETE /compute/v2.1/os-volumes/00f28cfa-538a-430a-8942-134f3e9e7359 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 15:59:03.006983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-69a833f9-96f9-492a-8496-656a073649a4 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Calling method '.version_select at 0x7fec9d850550>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:03.073525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-69a833f9-96f9-492a-8496-656a073649a4 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] HTTP exception thrown: Volume f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 could not be found. Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-69a833f9-96f9-492a-8496-656a073649a4 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Request method failure captured: Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/os-volumes/f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 HTTP/1.1 Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fGjb14DKcVFlrlvHknhXQHLJyLnEP3bWmj8-WXNWPYsLaqTiC1szGEGPkx6bO6jd3yoY4tC9-RKhL86Waam3zQCKFacTkKajLWiEuKks9KZT-vErXlC4a64vDQvYv5UEWHN-ZTRL455GV76wvD4nX_CM1FXXKxi6pzDwosaoHlavw Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 15:59:03.079879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_012877366afd4a609c139faa9ec9dd8b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/012877366afd4a609c139faa9ec9dd8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/012877366afd4a609c139faa9ec9dd8b"}]}] Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 012877366afd4a609c139faa9ec9dd8b Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesNegativeTest-496810223 Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: fd0a0767387943549d7f2c3c7a71b5df Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesNegativeTest-496810223-project Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Volume f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 could not be found. Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': 'f0765e09-9d29-4f17-8e7b-36c8c0eff1b7'} Aug 22 15:59:03.081231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 could not be found. (HTTP 404) (Request-ID: req-4b061314-aa48-46fa-b199-d027bbe73417) Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:03.081946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:59:03.083845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 could not be found. Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 15:59:03.084941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 could not be found. Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 could not be found. Aug 22 15:59:03.086059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.088161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-69a833f9-96f9-492a-8496-656a073649a4 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] Returning 404 to user: Volume f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:03.089217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-69a833f9-96f9-492a-8496-656a073649a4 tempest-VolumesNegativeTest-496810223 tempest-VolumesNegativeTest-496810223-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f0765e09-9d29-4f17-8e7b-36c8c0eff1b7" status: 404 len: 109 microversion: 2.1 time: 0.098557 Aug 22 15:59:03.091603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 12/30] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:59:02 2022] GET /compute/v2.1/os-volumes/f0765e09-9d29-4f17-8e7b-36c8c0eff1b7 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 15:59:03.791212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5a00e64e-a318-41a3-8d01-e6f38575c20d tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d7e4670>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:03.872913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-5a00e64e-a318-41a3-8d01-e6f38575c20d tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] HTTP exception thrown: Snapshot 9f99ad4e-a045-4178-8043-8d95ca4c8963 could not be found. Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5a00e64e-a318-41a3-8d01-e6f38575c20d tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Request method failure captured: Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 HTTP/1.1 Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6e7fkbvo8vsdNFkap73Ia8we3D7kByf44uVLZJ8hECKc5xD3ALgpdZO8Gi-1qyeMbpUZ35hQaJZ5SzvCxrJi9yG6G6prwT0wiR9vpnw3dvra6krTbTnpVg0Iw2mTx9T7xwpOXYHnkkgEy26t5tZdaYjdz-VSpXhFYTiUltxqnI16Y8 Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4b1fb486de22448693355418ab03efa7 Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 15:59:03.875865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1fb486de22448693355418ab03efa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4b1fb486de22448693355418ab03efa7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4b1fb486de22448693355418ab03efa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1fb486de22448693355418ab03efa7"}]}] Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4b1fb486de22448693355418ab03efa7 Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesSnapshotsTestJSON-2020168492-project Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: e50f17e6ba4449b89a2eb7688841983b Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2020168492-project Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Snapshot 9f99ad4e-a045-4178-8043-8d95ca4c8963 could not be found. Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '9f99ad4e-a045-4178-8043-8d95ca4c8963'} Aug 22 15:59:03.877252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9f99ad4e-a045-4178-8043-8d95ca4c8963 could not be found. (HTTP 404) (Request-ID: req-9bbd46af-2237-40e6-9ac6-90585772413e) Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.878663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:59:03.881255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9f99ad4e-a045-4178-8043-8d95ca4c8963 could not be found. Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 22 15:59:03.882345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9f99ad4e-a045-4178-8043-8d95ca4c8963 could not be found. Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9f99ad4e-a045-4178-8043-8d95ca4c8963 could not be found. Aug 22 15:59:03.884478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:03.892285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5a00e64e-a318-41a3-8d01-e6f38575c20d tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Returning 404 to user: Snapshot 9f99ad4e-a045-4178-8043-8d95ca4c8963 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:03.894633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5a00e64e-a318-41a3-8d01-e6f38575c20d tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963" status: 404 len: 111 microversion: 2.1 time: 0.108747 Aug 22 15:59:03.899167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 19/31] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Aug 22 15:59:03 2022] GET /compute/v2.1/os-snapshots/9f99ad4e-a045-4178-8043-8d95ca4c8963 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 15:59:03.908267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bdb3311f-c813-4d0d-b493-9f1f6d39e589 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9cfb59d0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:04.073970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bdb3311f-c813-4d0d-b493-9f1f6d39e589 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6" status: 202 len: 0 microversion: 2.1 time: 0.169808 Aug 22 15:59:04.074916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 13/32] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 15:59:03 2022] DELETE /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 15:59:04.086442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-85e06c99-1b28-4084-b7ca-79091e9bd693 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d8c8700>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:04.208820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-85e06c99-1b28-4084-b7ca-79091e9bd693 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6" status: 200 len: 345 microversion: 2.1 time: 0.125877 Aug 22 15:59:04.209391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 20/33] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:59:04 2022] GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:05.224513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-396fe05f-9863-4910-8f9a-b5c65ebdaae9 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9cfcc160>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:05.299274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-396fe05f-9863-4910-8f9a-b5c65ebdaae9 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] HTTP exception thrown: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-396fe05f-9863-4910-8f9a-b5c65ebdaae9 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Request method failure captured: Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 HTTP/1.1 Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6e7fkbvo8vsdNFkap73Ia8we3D7kByf44uVLZJ8hECKc5xD3ALgpdZO8Gi-1qyeMbpUZ35hQaJZ5SzvCxrJi9yG6G6prwT0wiR9vpnw3dvra6krTbTnpVg0Iw2mTx9T7xwpOXYHnkkgEy26t5tZdaYjdz-VSpXhFYTiUltxqnI16Y8 Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 4b1fb486de22448693355418ab03efa7 Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 15:59:05.301764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1fb486de22448693355418ab03efa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4b1fb486de22448693355418ab03efa7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4b1fb486de22448693355418ab03efa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1fb486de22448693355418ab03efa7"}]}] Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 4b1fb486de22448693355418ab03efa7 Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesSnapshotsTestJSON-2020168492-project Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: e50f17e6ba4449b89a2eb7688841983b Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2020168492-project Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '8f48e71f-8c77-4ecb-8690-ecda8ede14d6'} Aug 22 15:59:05.302872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. (HTTP 404) (Request-ID: req-da107a9c-8c0b-43aa-9fe0-7d109595dcfb) Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.303580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:59:05.304529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 15:59:05.305414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-396fe05f-9863-4910-8f9a-b5c65ebdaae9 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Returning 404 to user: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:05.306327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-396fe05f-9863-4910-8f9a-b5c65ebdaae9 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6" status: 404 len: 109 microversion: 2.1 time: 0.085000 Aug 22 15:59:05.327064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-04f13470-c1be-44a3-a597-c8e4fc9ee39e tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9d7e40d0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:05.335047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 14/34] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:59:05 2022] GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 15:59:05.385636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-04f13470-c1be-44a3-a597-c8e4fc9ee39e tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] HTTP exception thrown: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-04f13470-c1be-44a3-a597-c8e4fc9ee39e tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Request method failure captured: Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 HTTP/1.1 Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6e7fkbvo8vsdNFkap73Ia8we3D7kByf44uVLZJ8hECKc5xD3ALgpdZO8Gi-1qyeMbpUZ35hQaJZ5SzvCxrJi9yG6G6prwT0wiR9vpnw3dvra6krTbTnpVg0Iw2mTx9T7xwpOXYHnkkgEy26t5tZdaYjdz-VSpXhFYTiUltxqnI16Y8 Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4b1fb486de22448693355418ab03efa7 Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 15:59:05.388567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1fb486de22448693355418ab03efa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4b1fb486de22448693355418ab03efa7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4b1fb486de22448693355418ab03efa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1fb486de22448693355418ab03efa7"}]}] Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4b1fb486de22448693355418ab03efa7 Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesSnapshotsTestJSON-2020168492-project Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: e50f17e6ba4449b89a2eb7688841983b Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2020168492-project Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '8f48e71f-8c77-4ecb-8690-ecda8ede14d6'} Aug 22 15:59:05.389700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. (HTTP 404) (Request-ID: req-f2dae976-4f15-44a0-9825-00b763c5f612) Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.390335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 15:59:05.391240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 15:59:05.392233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-04f13470-c1be-44a3-a597-c8e4fc9ee39e tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Returning 404 to user: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:05.393125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-04f13470-c1be-44a3-a597-c8e4fc9ee39e tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6" status: 404 len: 109 microversion: 2.1 time: 0.068276 Aug 22 15:59:05.399606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-14938d30-d49c-491f-82dd-40d57050dbf4 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Calling method '.version_select at 0x7fec9cfcc4c0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:05.403469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 21/35] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 15:59:05 2022] DELETE /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 15:59:05.478865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-14938d30-d49c-491f-82dd-40d57050dbf4 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] HTTP exception thrown: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-14938d30-d49c-491f-82dd-40d57050dbf4 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Request method failure captured: Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 HTTP/1.1 Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6e7fkbvo8vsdNFkap73Ia8we3D7kByf44uVLZJ8hECKc5xD3ALgpdZO8Gi-1qyeMbpUZ35hQaJZ5SzvCxrJi9yG6G6prwT0wiR9vpnw3dvra6krTbTnpVg0Iw2mTx9T7xwpOXYHnkkgEy26t5tZdaYjdz-VSpXhFYTiUltxqnI16Y8 Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 4b1fb486de22448693355418ab03efa7 Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 15:59:05.486443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1fb486de22448693355418ab03efa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4b1fb486de22448693355418ab03efa7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4b1fb486de22448693355418ab03efa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1fb486de22448693355418ab03efa7"}]}] Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 4b1fb486de22448693355418ab03efa7 Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2020168492 Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesSnapshotsTestJSON-2020168492-project Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: e50f17e6ba4449b89a2eb7688841983b Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2020168492-project Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '8f48e71f-8c77-4ecb-8690-ecda8ede14d6'} Aug 22 15:59:05.488479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. (HTTP 404) (Request-ID: req-c45c5ae6-9479-4521-b136-45218dc888f6) Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.489300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 15:59:05.490424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 15:59:05.491798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. Aug 22 15:59:05.492938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 15:59:05.494862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-14938d30-d49c-491f-82dd-40d57050dbf4 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] Returning 404 to user: Volume 8f48e71f-8c77-4ecb-8690-ecda8ede14d6 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 15:59:05.497241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-14938d30-d49c-491f-82dd-40d57050dbf4 tempest-VolumesSnapshotsTestJSON-2020168492 tempest-VolumesSnapshotsTestJSON-2020168492-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6" status: 404 len: 109 microversion: 2.1 time: 0.101409 Aug 22 15:59:05.514361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 15/36] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 15:59:05 2022] GET /compute/v2.1/os-volumes/8f48e71f-8c77-4ecb-8690-ecda8ede14d6 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 15:59:08.525588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1333183576", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b541efda-15ea-4562-82cd-397beeb78e3b"}], "security_groups": [{"name": "tempest-securitygroup--1281399767"}], "key_name": "tempest-keypair-231912585", "user_data": "}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:09.428322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] validate_networks() for [('b541efda-15ea-4562-82cd-397beeb78e3b', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 15:59:10.514392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-84258971", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:10.719561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] validate_networks() for [('14653ea1-7c5c-49e7-aba7-9205a366cf57', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 15:59:11.750254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 15:59:11.756201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 15:59:11.760808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 15:59:11.764023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 15:59:11.767967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 15:59:11.832013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:11.836051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:11.836702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:11.840582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:11.841239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:11.841816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:11.917472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 15:59:11.929372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for user 1b896f9378dc4188868734e05ddd39fb and project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 15:59:11.963675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 15:59:11.967540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 15:59:12.117454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e1dee75f-0fea-4dbf-bb74-4be2bafc987c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.601321 Aug 22 15:59:12.124168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 22/37] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 15:59:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 3609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 15:59:12.808446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:12.944621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-601851da-cfc3-4c0b-963e-163d1fb0eebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'create', calling method: .version_select at 0x7fec9ceed0d0>, body: {"keypair": {"name": "tempest-keypair-1694654183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzVGc9UPdwIDngpF+7K98dKwXYYSvlLaD+UywvSbjBI2brn1s1csFNwFxkaJWcsxskJahCSWEiLBjTO7yOX1LKtnkJYmI2sc29kOk3mY2SRY8I+Z1uZV3jaorx1xXwclA=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:13.020783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-601851da-cfc3-4c0b-963e-163d1fb0eebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Getting quotas for project 5d8f1eeb5f85409eb243790c361f247a. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 15:59:13.036353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-601851da-cfc3-4c0b-963e-163d1fb0eebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Getting quotas for user c71533864af94653be067b61e1c83789 and project 5d8f1eeb5f85409eb243790c361f247a. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 15:59:13.155824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-601851da-cfc3-4c0b-963e-163d1fb0eebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.030261 Aug 22 15:59:13.156991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 23/38] 10.222.0.40 () {62 vars in 1200 bytes} [Mon Aug 22 15:59:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1032 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 15:59:13.175945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c3770f6-5e2f-4536-a1aa-b0d1492785a0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:13.181642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6c3770f6-5e2f-4536-a1aa-b0d1492785a0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:13.482587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c3770f6-5e2f-4536-a1aa-b0d1492785a0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:13.529050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6c3770f6-5e2f-4536-a1aa-b0d1492785a0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1241 microversion: 2.1 time: 0.369173 Aug 22 15:59:13.551207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 24/39] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:13 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1241 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:13.917396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 15:59:13.917857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 15:59:13.918303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 15:59:13.918711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 15:59:13.919582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 15:59:13.945798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:13.948510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:13.949150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:13.951417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:13.954991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:13.955719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:14.076326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Getting quotas for project cf2968f38ecf4e1aaf22dad09767c744. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 15:59:14.099185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Getting quotas for user 79dc62d7bb984157a117f79001a2ad68 and project cf2968f38ecf4e1aaf22dad09767c744. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 15:59:14.167993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 15:59:14.181876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 15:59:14.473266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3756c96c-c0ca-4eb3-b4cc-d19e067724e3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.544333 Aug 22 15:59:14.482853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 16/40] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 15:59:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 4546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 15:59:14.492410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-03c8b2fa-c9f0-4a18-905a-fa4d638d4e8e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:14.495363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-03c8b2fa-c9f0-4a18-905a-fa4d638d4e8e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:14.944564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-03c8b2fa-c9f0-4a18-905a-fa4d638d4e8e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:14.998710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-03c8b2fa-c9f0-4a18-905a-fa4d638d4e8e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1220 microversion: 2.1 time: 0.505448 Aug 22 15:59:15.001275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 17/41] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:14 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1220 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:15.011598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-206339f0-4f16-45f9-8622-5a050eebfb3b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:15.015803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-206339f0-4f16-45f9-8622-5a050eebfb3b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:15.198720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-206339f0-4f16-45f9-8622-5a050eebfb3b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:15.209899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-206339f0-4f16-45f9-8622-5a050eebfb3b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1241 microversion: 2.1 time: 0.207334 Aug 22 15:59:15.216025 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 18/42] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:15 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1241 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:15.257940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2071462634", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "networks": [{"uuid": "a858aa46-bf14-4716-809d-b4fc392182dd"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:15.383659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] validate_networks() for [('a858aa46-bf14-4716-809d-b4fc392182dd', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 15:59:15.531005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-722786900", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:15.668982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] validate_networks() for [('14653ea1-7c5c-49e7-aba7-9205a366cf57', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 15:59:18.128627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 15:59:18.129187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 15:59:18.129505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 15:59:18.129919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 15:59:18.130339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 15:59:18.160792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:18.161953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:18.164563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:18.166332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:18.167418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:18.168141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:18.213047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Getting quotas for project 867033dda17c45ac9bf0253619b945cc. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 15:59:18.246411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Getting quotas for user da60563ae9704576bf10467b23ac9271 and project 867033dda17c45ac9bf0253619b945cc. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 15:59:18.294104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 15:59:18.297574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 15:59:18.421608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5b01f621-d9ce-445c-9b5d-7483c73a5122 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.026564 Aug 22 15:59:18.424442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 25/43] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 15:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 15:59:18.445723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:18.450950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:18.476615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:18.493328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:18.494296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:18.496979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:18.499712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:18.501589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:18.729716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 15:59:18.730302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 15:59:18.730648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 15:59:18.738619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 15:59:18.739068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 15:59:18.798889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:18.799475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:18.806524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:18.807420 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:18.807856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:18.808293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:18.902355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Getting quotas for project cf2968f38ecf4e1aaf22dad09767c744. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 15:59:18.907784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Getting quotas for user 79dc62d7bb984157a117f79001a2ad68 and project cf2968f38ecf4e1aaf22dad09767c744. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 15:59:18.977871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 15:59:18.991203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 15:59:19.191129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a7dcefd4-5126-4c5a-889d-2288f191b576 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.664527 Aug 22 15:59:19.194816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 19/44] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 15:59:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 15:59:19.215840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8582ab6e-6496-47b9-b205-51398c6a70ba tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:19.217975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8582ab6e-6496-47b9-b205-51398c6a70ba tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:19.353429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:19.394989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-49a0060d-b016-4bd9-ad89-1707849f596e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1299 microversion: 2.1 time: 0.964743 Aug 22 15:59:19.396149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 26/45] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:18 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1299 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:19.417851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2e918f68-9e88-4ae1-85c0-9d751b186151 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:19.420757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2e918f68-9e88-4ae1-85c0-9d751b186151 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:19.551670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8582ab6e-6496-47b9-b205-51398c6a70ba tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:19.563271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8582ab6e-6496-47b9-b205-51398c6a70ba tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1215 microversion: 2.1 time: 0.366041 Aug 22 15:59:19.569781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 20/46] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:19 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1215 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:19.593881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2e918f68-9e88-4ae1-85c0-9d751b186151 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:19.602131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2e918f68-9e88-4ae1-85c0-9d751b186151 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1221 microversion: 2.1 time: 0.203210 Aug 22 15:59:19.602742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 27/47] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:19 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1221 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:20.418061 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:20.419648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:20.442198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:20.442733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:20.455522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:20.459415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:20.464181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:20.467455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:20.589269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:20.589896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:20.626900 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:20.653407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:20.653968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:20.654780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:20.655272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:20.663092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:20.947654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:20.963226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-470028d5-d39b-4add-9bf1-62c32c4f1eae tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1267 microversion: 2.1 time: 0.378835 Aug 22 15:59:20.965122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 28/48] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:20 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1267 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:20.979745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:20.983608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:21.001744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:21.006925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:21.007709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:21.010701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:21.017372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:21.022799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:21.176627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:21.220681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dbb9044a-2e2f-4ea5-9288-7c9029fa345a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1299 microversion: 2.1 time: 0.802937 Aug 22 15:59:21.224438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 21/49] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:20 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1299 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:21.242199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-263779898", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02210ee6-9d4f-4a7c-8f78-2c26d29214a0"}], "security_groups": [{"name": "tempest-securitygroup--164891594"}], "key_name": "tempest-keypair-1694654183", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:21.365003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:21.386473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d98ebc28-6050-4e90-85e0-1d7878f87e56 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1225 microversion: 2.1 time: 0.412538 Aug 22 15:59:21.392546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 29/50] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:20 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1225 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:21.974027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] validate_networks() for [('02210ee6-9d4f-4a7c-8f78-2c26d29214a0', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 15:59:21.989006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:21.989469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:21.999845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:22.000352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:22.000795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:22.001514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:22.014725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:22.016567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:22.582184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:22.613961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aa2b9eb3-7363-43f0-acf1-afada0a2c1db tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1273 microversion: 2.1 time: 0.631083 Aug 22 15:59:22.617702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 30/51] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:21 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1273 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:22.630873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:22.635682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:22.672895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:22.673813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:22.683676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:22.684757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:22.687359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:22.687921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:23.032040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:23.042773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c21471aa-eba8-47f1-9764-a3fe384df403 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1299 microversion: 2.1 time: 0.423736 Aug 22 15:59:23.044064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 31/52] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:22 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1299 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:23.049390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:23.050861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:23.058431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:23.059551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:23.060235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:23.061488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:23.062863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:23.063722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:23.241708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:23.269221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a12f85ed-7466-4e93-8cf8-fbd18e8fb3ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1279 microversion: 2.1 time: 0.219963 Aug 22 15:59:23.270316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 32/53] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:23 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1279 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:23.550350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 15:59:23.550856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 15:59:23.551363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 15:59:23.551773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 15:59:23.552358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 15:59:23.568230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:23.570112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:23.571999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:23.573092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:23.573941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:23.574594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:23.606285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Getting quotas for project 5d8f1eeb5f85409eb243790c361f247a. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 15:59:23.616237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Getting quotas for user c71533864af94653be067b61e1c83789 and project 5d8f1eeb5f85409eb243790c361f247a. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 15:59:23.638491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:23.639121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:23.641184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 15:59:23.643686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 15:59:23.649686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:23.650190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:23.650649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:23.651417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:23.657981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:23.660555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:23.773754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cb44d395-0fc0-4918-933f-28fca88ba5d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.546556 Aug 22 15:59:23.777752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 22/54] 10.222.0.40 () {62 vars in 1188 bytes} [Mon Aug 22 15:59:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 15:59:23.802291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b07cfb51-55ff-4f72-a2e5-37a647a1c11d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:23.807282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b07cfb51-55ff-4f72-a2e5-37a647a1c11d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:23.862701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:23.872053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f73a1b96-a623-48c7-9954-3f32388f0490 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1273 microversion: 2.1 time: 0.237626 Aug 22 15:59:23.895497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 33/55] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:23 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:23.952548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b07cfb51-55ff-4f72-a2e5-37a647a1c11d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:23.963396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b07cfb51-55ff-4f72-a2e5-37a647a1c11d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:23.965219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b07cfb51-55ff-4f72-a2e5-37a647a1c11d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:23.973763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b07cfb51-55ff-4f72-a2e5-37a647a1c11d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1281 microversion: 2.20 time: 0.182260 Aug 22 15:59:23.974646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 23/56] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:23 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:24.068451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:24.070508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:24.084264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:24.085119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:24.085778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:24.093079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:24.094093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:24.094772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:24.295556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:24.296187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:24.322577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:24.323185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:24.323770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:24.324504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:24.327123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:24.328426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:24.600211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:24.615636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3e3c5e9d-f4f0-4dea-8b8c-9964ac6cd2ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1279 microversion: 2.1 time: 0.318066 Aug 22 15:59:24.616310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 24/57] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:24 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1279 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:24.719094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:24.729751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-33cad4bd-fc61-4bc9-ac94-9957466d9cb3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.666168 Aug 22 15:59:24.735582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 34/58] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:24 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:24.910942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:24.914664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:24.923530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:24.924250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:24.924843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:24.925704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:24.926427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:24.927251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:25.000981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:25.001818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:25.014901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:25.019121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:25.019843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:25.021473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:25.022852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:25.024048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:25.275588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:25.285741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:25.292081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:25.298317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-21284712-90a5-4997-9aa6-b470f719adfb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1285 microversion: 2.20 time: 0.302311 Aug 22 15:59:25.303799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 35/59] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:24 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1285 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:25.377145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:25.397794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d51a9909-ea06-4ebf-a68d-e3bc3106fd2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.493237 Aug 22 15:59:25.414653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 25/60] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:24 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:25.636737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:25.637330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:25.646971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:25.647733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:25.649087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:25.652867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:25.653541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:25.654200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:25.758237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:25.758873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:25.767312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:25.767873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:25.768321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:25.778187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:25.778812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:25.779267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:25.851319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:25.872773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c9d03efb-c886-4a42-ae9f-d2bd03c5da6e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1279 microversion: 2.1 time: 0.234892 Aug 22 15:59:25.875737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 36/61] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:25 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:26.322286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:26.331788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:26.333377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:26.350163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f371c523-6ca4-4220-98f4-2a2388eac88b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.595925 Aug 22 15:59:26.354757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:26.362522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 26/62] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:25 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:26.365683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:26.369163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:26.371246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:26.374162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:26.374892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:26.425074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:26.425803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:26.434659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:26.447639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:26.448434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:26.452041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:26.452937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:26.453642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:26.616679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:26.626149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:26.634384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:26.653691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8989b873-3268-4fe2-a603-115961ab8fb0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1277 microversion: 2.20 time: 0.329721 Aug 22 15:59:26.655421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 37/63] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:26 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1277 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:26.898158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:26.899100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:26.910234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:26.917003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:26.920303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:26.922504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:26.927266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:26.933714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:27.077084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:27.092756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-321d99b9-256a-46af-a85d-34a2429cce88 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.671990 Aug 22 15:59:27.095447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 27/64] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:26 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:27.191727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:27.216652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c06932c3-589f-4ead-9502-7bfe558924ad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1279 microversion: 2.1 time: 0.323406 Aug 22 15:59:27.219175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 38/65] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:26 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1279 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:27.385335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:27.385957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:27.395464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:27.396217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:27.396661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:27.397376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:27.397827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:27.398249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:27.561185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:27.571678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-016b2e18-69ea-4acc-afd8-6a95636e6f07 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.189817 Aug 22 15:59:27.572695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 28/66] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:27 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:27.682186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:27.686465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:27.696605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:27.697348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:27.700007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:27.701014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:27.703538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:27.704228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:27.785131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:27.793349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:27.795047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:27.796786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eeaae5e6-b7a4-41f9-90e1-1ab259cf7c3b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.118406 Aug 22 15:59:27.807379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 39/67] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:27 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:28.120485 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:28.122216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:28.128919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:28.129531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:28.130179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:28.131059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:28.131603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:28.132040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:28.243994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:28.244803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:28.253096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:28.270298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:28.272832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:28.273343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:28.279298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:28.279831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:28.280278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:28.325689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:28.334387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a216596f-779b-42df-a787-8402bc50e463 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.217893 Aug 22 15:59:28.347374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 29/68] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:28 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:28.370507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:28.381720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9e1c27ea-1c22-4020-a338-d0289ffa7134 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1279 microversion: 2.1 time: 0.143794 Aug 22 15:59:28.382442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 40/69] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:28 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:28.593968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:28.594580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:28.600506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:28.600999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:28.601439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:28.602133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:28.602590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:28.603019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:28.779690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:28.785526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b0a9d24f-c5ce-418f-b1a0-090ff5db08d9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.195353 Aug 22 15:59:28.786217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 30/70] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:28 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:28.820712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:28.821329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:28.827995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:28.828850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:28.829587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:28.831111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:28.831851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:28.832623 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:28.904546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:28.914894 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:28.916450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:28.917573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cce60ab8-709d-4a5a-af05-3d71d614089c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.100804 Aug 22 15:59:28.918139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 41/71] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:28 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:29.354759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:29.355559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:29.361590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.362076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.362514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.363212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.363978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.364407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.406770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:29.407481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:29.423503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.424952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.425392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.426258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.426723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.427155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.571270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:29.579293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e2dd5376-3ca7-4801-8882-46416c276d9c tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.228581 Aug 22 15:59:29.580428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 31/72] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:29 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:29.600099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=20 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:29.633708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:29.637456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:29.643492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cbe19aaf-4056-4146-971f-e654ca69f791 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.242830 Aug 22 15:59:29.644310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 42/73] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:29 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:29.676659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-e0d93bf6-60e0-4d91-8d64-e50dc3e80232 req-11a46074-fad7-47cd-8915-fbfbb3627c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639501de-5f89-4426-b93c-0635a1caa0c6", "tag": "72b29b7d-7e2a-4947-9b67-66d1c3ca1834"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:29.690172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e0d93bf6-60e0-4d91-8d64-e50dc3e80232 req-11a46074-fad7-47cd-8915-fbfbb3627c64 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.690933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e0d93bf6-60e0-4d91-8d64-e50dc3e80232 req-11a46074-fad7-47cd-8915-fbfbb3627c64 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.691375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e0d93bf6-60e0-4d91-8d64-e50dc3e80232 req-11a46074-fad7-47cd-8915-fbfbb3627c64 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.711976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-e0d93bf6-60e0-4d91-8d64-e50dc3e80232 req-11a46074-fad7-47cd-8915-fbfbb3627c64 service nova] Creating event network-changed:72b29b7d-7e2a-4947-9b67-66d1c3ca1834 for instance 639501de-5f89-4426-b93c-0635a1caa0c6 on hv-cinder-85400 Aug 22 15:59:29.712484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e0d93bf6-60e0-4d91-8d64-e50dc3e80232 req-11a46074-fad7-47cd-8915-fbfbb3627c64 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 15:59:29.712869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e0d93bf6-60e0-4d91-8d64-e50dc3e80232 req-11a46074-fad7-47cd-8915-fbfbb3627c64 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 15:59:29.714106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.714721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.715145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.715884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.716325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.716737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.727858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.compute.rpcapi [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 15:59:29.729104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] Releasing lock "compute-rpcapi-router" {{(pid=121080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 15:59:29.763578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c5e7d884-5b3b-47de-97a7-c8c3c38b23cb None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181806 Aug 22 15:59:29.764170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 32/74] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 15:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:29.806739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:29.807853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:29.814372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.815776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.816407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.817493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.818111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.818698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.941271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:29.941971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:29.945054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:29.949468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.949957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.950404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.951107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:29.951585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:29.952011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:29.968443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:29.976549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-027d3107-4408-4053-9cac-9b060db35b0d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.174239 Aug 22 15:59:29.977410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 43/75] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:29 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:30.059606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:30.068952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:30.070536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:30.071877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6c591b25-0d1b-4476-90f4-3edfebe66284 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.136062 Aug 22 15:59:30.072439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 33/76] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:29 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:30.604121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:30.605273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:30.623484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:30.624411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:30.625184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:30.626054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:30.626946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:30.628000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:30.665098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:30.665829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:30.678146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:30.692050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:30.702646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:30.714179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:30.714927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:30.715554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:30.899773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:30.910544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-983dd03c-d5f2-4072-bcd6-ee42b60abf9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.311139 Aug 22 15:59:30.911650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 44/77] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:30 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:30.972467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:30.982212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e7a1b716-f196-40e0-8701-b57213a46b21 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.321267 Aug 22 15:59:30.996003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 34/78] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:30 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:31.004585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:31.005491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:31.012977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:31.013562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:31.014150 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:31.014892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:31.015524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:31.016164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:31.097678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:31.098638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:31.113382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:31.114793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:31.116040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:31.118454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:31.119109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:31.119728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:31.285208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:31.295017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:31.297139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:31.302848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:31.304562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-839e8217-426a-4808-8fd3-650a71af8d54 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.210888 Aug 22 15:59:31.305361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 35/79] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:31 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:31.310825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7e666da-89af-43e2-aec8-64283dab084b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.312168 Aug 22 15:59:31.311450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 45/80] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:30 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:31.779166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-df99dcc1-c865-4e86-aa6b-96ee8558d5fb req-96c3049f-a02d-40d3-a838-cc878edcd312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cbc6b6e-511f-4f80-8f1c-10fc819eb319", "tag": "cfed9e3e-cded-427a-b9ac-9070c083cfb4"}, {"name": "network-changed", "server_uuid": "91e589fa-e174-4b10-a78f-dd18b10b90f5", "tag": "3dd65d89-d95c-47fa-9299-3a65992872b8"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:31.790646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-df99dcc1-c865-4e86-aa6b-96ee8558d5fb req-96c3049f-a02d-40d3-a838-cc878edcd312 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:31.791125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-df99dcc1-c865-4e86-aa6b-96ee8558d5fb req-96c3049f-a02d-40d3-a838-cc878edcd312 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:31.791579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-df99dcc1-c865-4e86-aa6b-96ee8558d5fb req-96c3049f-a02d-40d3-a838-cc878edcd312 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:31.804246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-df99dcc1-c865-4e86-aa6b-96ee8558d5fb req-96c3049f-a02d-40d3-a838-cc878edcd312 service nova] Creating event network-changed:cfed9e3e-cded-427a-b9ac-9070c083cfb4 for instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 on hv-cinder-85400 Aug 22 15:59:31.804751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-df99dcc1-c865-4e86-aa6b-96ee8558d5fb req-96c3049f-a02d-40d3-a838-cc878edcd312 service nova] Creating event network-changed:3dd65d89-d95c-47fa-9299-3a65992872b8 for instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 on hv-cinder-85400 Aug 22 15:59:31.810829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-df99dcc1-c865-4e86-aa6b-96ee8558d5fb req-96c3049f-a02d-40d3-a838-cc878edcd312 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035597 Aug 22 15:59:31.811434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 36/81] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 15:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:31.932529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:31.933425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:31.940559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:31.941040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:31.941468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:31.942200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:31.942645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:31.943057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:32.026341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:32.037265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:32.050647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:32.051223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:32.051775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:32.052585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:32.053055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:32.053919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:32.118950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:32.126878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7015703-ad9d-4da6-a65c-c931c161f37a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.198775 Aug 22 15:59:32.127511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 46/82] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:31 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:32.208507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:32.217115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-80c54cb6-195d-4c43-a0e7-ef757ba714ab tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.213058 Aug 22 15:59:32.217706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 37/83] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:32 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:32.328906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:32.329551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:32.337031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:32.337642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:32.338129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:32.338691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:32.339212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:32.340025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:32.340602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:32.341096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:32.343589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:32.344086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:32.344558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:32.345196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:32.345657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:32.346087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:32.429262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:32.442719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:32.444035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:32.447305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e867398e-d15a-4138-b4aa-d055f5c3fabd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.121765 Aug 22 15:59:32.451370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 47/84] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:32 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:32.534803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:32.542518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fb95386d-6e9d-421a-9b45-d5e732a8231a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.209435 Aug 22 15:59:32.543085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 38/85] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:32 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:33.149426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:33.150051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:33.153393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:33.157495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:33.158111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:33.158621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:33.159508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:33.160045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:33.160550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:33.237979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:33.238635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:33.244967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:33.245455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:33.245894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:33.246594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:33.247076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:33.247535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:33.268041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:33.307274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:33.316585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-03a82e32-0027-407e-8098-1c4aaaf70d2e tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.171071 Aug 22 15:59:33.323395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 48/86] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:33 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:33.425507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:33.435161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cf050f49-e92c-4ba0-9ffb-78fc86ff7afb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.200933 Aug 22 15:59:33.435779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 39/87] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:33 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:33.475275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:33.476462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:33.483384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:33.484200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:33.484645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:33.485352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:33.485810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:33.486272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:33.566059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:33.566059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:33.576623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:33.577390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:33.577985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:33.578899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:33.579569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:33.580739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:33.591842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:33.608722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:33.610252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:33.617468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0a68c3f4-4455-405b-a90f-37a5147207a6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.141953 Aug 22 15:59:33.618284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 49/88] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:33 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:33.794078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:33.802909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d1f92563-0c68-4caa-bab6-75bef1f91baf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.242803 Aug 22 15:59:33.804177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 40/89] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:33 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:34.340339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:34.341133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:34.347826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:34.348758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:34.349193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:34.350186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:34.351032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:34.351701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:34.460974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:34.462350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:34.474833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=26 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:34.478788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:34.479288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:34.479759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:34.480468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:34.480925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:34.481408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:34.588607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:34.606376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-83e3210d-e567-4c7b-a7d3-c1e23ffb7ec5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.269736 Aug 22 15:59:34.606971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 50/90] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:34 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:34.647749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:34.651868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:34.659625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:34.661819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:34.662423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:34.664315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:34.665134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:34.666713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:34.685380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:34.695287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a6815d60-a435-479b-93ca-62634e6b0c5e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.238854 Aug 22 15:59:34.696385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 41/91] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:34 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:34.803261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:34.813577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:34.815904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:34.817541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fe72dd19-ee56-44af-8ba2-51740e5c394f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.178358 Aug 22 15:59:34.819065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 51/92] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:34 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:34.844436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:34.847285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:34.860262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:34.865685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:34.866259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:34.867031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:34.867544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:34.867996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:35.098785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:35.107408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a17fcfdb-479f-4d78-8e94-c44c3d78729f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.268390 Aug 22 15:59:35.108615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 42/93] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:34 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:35.629083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:35.629717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:35.635702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:35.636208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:35.636634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:35.637317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:35.637768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:35.638184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:35.722080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:35.724377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:35.729691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:35.730174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:35.730606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:35.731301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:35.731781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:35.732195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:35.824430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:35.832710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-20f71dce-62cd-4171-8864-30ad1c205514 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.208041 Aug 22 15:59:35.834240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 52/94] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:35 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:35.848050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:35.848924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:35.855069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:35.855591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:35.856029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:35.856739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:35.857206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:35.857621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:35.894318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:35.902686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4d1a96b3-fcac-42cf-a7f4-53be0a5bfb0e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.184530 Aug 22 15:59:35.903273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 43/95] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:35 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:35.924566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:35.932931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:35.934496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:35.935603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c37505b7-67fd-4113-a0e7-98878b4ffc77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.092000 Aug 22 15:59:35.936160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 53/96] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:35 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:36.131072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:36.131834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:36.137947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:36.138513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:36.138965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:36.139788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:36.140241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:36.143947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:36.278810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:36.287400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-108ed22b-ae99-4492-a578-5bf0438aa2f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.160209 Aug 22 15:59:36.287971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 44/97] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:36 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:36.854391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:36.855012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:36.860990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:36.861474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:36.861914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:36.862605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:36.863066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:36.863517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:36.930130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:36.931407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:36.937456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:36.937930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:36.938365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:36.939301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:36.940459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:36.941024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:37.054780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:37.063954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2d6e97a3-ba45-4b63-bc5c-da9c301c29b9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.213434 Aug 22 15:59:37.077846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 54/98] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:36 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:37.077846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:37.077846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:37.077846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:37.078977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:37.078977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:37.079968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:37.080539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:37.081076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:37.136499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:37.144865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2900c7bb-ddf1-49f3-866f-796991ce060a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.224655 Aug 22 15:59:37.145443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 45/99] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:36 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:37.153762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:37.162661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:37.164228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:37.165400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-45dc89dd-fdf0-4346-bcce-bf518a8c4cb1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.098871 Aug 22 15:59:37.165940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 55/100] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:37 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:37.308085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:37.308892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:37.315491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:37.316114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:37.316627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:37.317408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:37.317937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:37.318453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:37.500761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:37.509006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dbd533a9-01fe-4ea5-8d71-88c31e0c450f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.204804 Aug 22 15:59:37.510204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 46/101] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:37 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:38.085671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:38.086435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:38.093345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:38.094000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:38.094508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:38.095348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:38.096430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:38.096929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:38.165256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:38.165936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:38.172070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:38.172417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:38.173045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:38.174348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:38.174810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:38.175343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:38.294470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:38.305232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c7e76168-f967-45d4-9e8f-92f23ac9983a tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.223524 Aug 22 15:59:38.320377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 56/102] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:38 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:38.325292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:38.325913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:38.333897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:38.334584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:38.335159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:38.336054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:38.336643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:38.337201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:38.345504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:38.355121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4e393aed-8b9c-46f8-98e9-8be2227f3ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.193682 Aug 22 15:59:38.355817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 47/103] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:38 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:38.401539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:38.409547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:38.411057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:38.412191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dc046ba6-8c56-4685-a21c-dd0b9dbf7876 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.090753 Aug 22 15:59:38.412746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 57/104] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:38 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:38.530113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:38.530811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:38.537018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:38.537831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:38.539062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:38.539965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:38.541401 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:38.541839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:38.679178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:38.687362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e25f6a39-38a8-4798-8f82-0bc59988b4af tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.160977 Aug 22 15:59:38.699746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 48/105] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:38 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:39.327063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:39.327727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:39.333975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:39.334516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:39.334898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:39.335610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:39.336060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:39.336488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:39.377779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:39.379128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:39.388275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:39.388756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:39.389374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:39.390435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:39.391157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:39.391792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:39.520637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:39.531769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7809b12d-4364-447b-bd59-3d817b799dcd tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.208268 Aug 22 15:59:39.534799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 58/106] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:39 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:39.544409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:39.545393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:39.554226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:39.555117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:39.555600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:39.556656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:39.558030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:39.558473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:39.585727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:39.586640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:39.596509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-96118f50-7116-4c3a-8ed2-62f5f2b08106 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.224200 Aug 22 15:59:39.597798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 49/107] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:39 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:39.638610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:39.648419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:39.649957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:39.651126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aa258dd5-000e-4dd5-aa4e-d9c1bd9f7c8e tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.114969 Aug 22 15:59:39.651880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 59/108] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:39 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:39.715862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:39.717079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:39.724717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=8 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:39.726759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:39.728349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:39.728797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:39.729877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:39.730349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:39.730780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:39.872515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:39.880188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f2e9603c-1c29-4da8-b066-c036033a1eac tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.169902 Aug 22 15:59:39.880751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 50/109] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:39 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:40.558111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:40.559999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:40.574908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:40.576390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:40.577146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:40.579470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:40.581064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:40.581504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:40.629956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:40.634577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:40.681501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:40.682386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:40.683125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:40.684034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:40.684486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:40.684916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:40.809574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:40.817854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-219fccaa-78ff-4482-9644-abd99dec6cca tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.264902 Aug 22 15:59:40.818434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 60/110] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:40 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:40.837070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:40.837689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:40.843612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:40.844094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:40.844528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:40.845232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:40.846251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:40.846663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:40.859219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:40.876446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-088ff098-20fd-4a17-a5fe-3790d3ef318b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.253604 Aug 22 15:59:40.877096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 51/111] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:40 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:40.901166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:40.901955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:40.908664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:40.909182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:40.909478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:40.909625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:40.910400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:40.910849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:40.911288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:40.921499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:40.923045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:40.924442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0100b55d-3b90-46f1-96df-cc91e94d5920 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.091503 Aug 22 15:59:40.925867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 61/112] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:40 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:41.044624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:41.052863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ec8c08f2-20a0-426b-bdb2-62c5699dfe9d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.155580 Aug 22 15:59:41.053430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 52/113] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:40 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:41.838206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:41.838815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:41.845014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:41.845511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:41.845954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:41.846655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:41.847382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:41.847666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:41.887829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:41.888441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:41.895004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:41.895524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:41.895961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:41.896666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:41.897121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:41.897553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:42.033281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:42.041270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c1dd8120-5afa-4cf6-b37f-2660013ff4d8 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.206900 Aug 22 15:59:42.042116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 62/114] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:41 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:42.060189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:42.060610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:42.061171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:42.067062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:42.067586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:42.068019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:42.068980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:42.069593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:42.070021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:42.070498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-47d4abaa-3cbf-43b2-9f92-f202048fe0b5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.186454 Aug 22 15:59:42.071067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 53/115] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:41 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:42.077294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:42.078052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:42.084997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:42.085672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:42.086135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:42.086828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:42.087274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:42.087714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:42.133813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:42.142045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:42.144170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:42.145280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a2b76a0e-d2f9-4ab0-941f-935e2b36ba74 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1333 microversion: 2.20 time: 0.088681 Aug 22 15:59:42.145844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 63/116] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:42 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:42.228074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:42.236053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-60a6b0ee-5302-4dff-87fa-041f8e54c0dc tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.163906 Aug 22 15:59:42.236834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 54/117] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:42 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:43.062965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:43.063819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:43.082019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:43.082737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:43.083667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:43.085223 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:43.086347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:43.087413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:43.092221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:43.092926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:43.104843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:43.105343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:43.107057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:43.107880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:43.108368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:43.108773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:43.498556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:43.518840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d994f7b9-b149-4fc0-9df7-4b3cd4d5383f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.451943 Aug 22 15:59:43.520119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 64/118] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:43 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:43.526806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:43.527996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:43.544233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:43.545304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:43.545304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:43.545853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:43.546309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:43.546727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:43.836285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:43.852278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d80b11e8-47fe-4e82-b223-d5edc294c90c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.764835 Aug 22 15:59:43.855950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 55/119] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:43 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:43.871186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:43.875567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:43.883019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:43.893613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:43.894876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:43.898346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:43.898928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:43.899318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:43.900513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2331680e-3d48-407c-a13b-8f7639fd4c9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1339 microversion: 2.20 time: 0.379206 Aug 22 15:59:43.901334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:43.902065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:43.903220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:43.911386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 65/120] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:43 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1339 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:43.918937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:44.107527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-9571337f-056d-4dac-a045-439d2ac9be00 req-11542ce3-c7b2-466f-8d45-a85e66ff5954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d17721-4fcc-449b-af1c-c80802160428", "tag": "be4edab1-bacb-43d0-8181-3d6691f0cef0"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:44.136867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-9571337f-056d-4dac-a045-439d2ac9be00 req-11542ce3-c7b2-466f-8d45-a85e66ff5954 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.138527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-9571337f-056d-4dac-a045-439d2ac9be00 req-11542ce3-c7b2-466f-8d45-a85e66ff5954 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.139141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-9571337f-056d-4dac-a045-439d2ac9be00 req-11542ce3-c7b2-466f-8d45-a85e66ff5954 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:44.166942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-9571337f-056d-4dac-a045-439d2ac9be00 req-11542ce3-c7b2-466f-8d45-a85e66ff5954 service nova] Creating event network-changed:be4edab1-bacb-43d0-8181-3d6691f0cef0 for instance a9d17721-4fcc-449b-af1c-c80802160428 on hv-cinder-85400 Aug 22 15:59:44.168218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-9571337f-056d-4dac-a045-439d2ac9be00 req-11542ce3-c7b2-466f-8d45-a85e66ff5954 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121079) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 15:59:44.168803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-9571337f-056d-4dac-a045-439d2ac9be00 req-11542ce3-c7b2-466f-8d45-a85e66ff5954 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121079) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 15:59:44.170067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.172679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.174164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:44.176226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.176889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.177515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:44.190307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.compute.rpcapi [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 15:59:44.191693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=121079) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 15:59:44.237759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ecb9497e-be9d-48d1-bc2c-a817bbe9e0b4 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134686 Aug 22 15:59:44.239585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 66/121] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 15:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 15:59:44.429741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:44.438638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5c94c64a-0e2e-44d8-b79c-9edd34e0425a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.580223 Aug 22 15:59:44.441654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 56/122] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:43 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:44.547700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:44.549135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:44.555743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.556234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.556754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:44.557366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.557823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.558255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:44.742777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:44.750906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-651074f6-1c52-4df3-a88c-4fef374b5c7f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.209216 Aug 22 15:59:44.752440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 67/123] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:44 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:44.883862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:44.884475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:44.890558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.891039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.891496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:44.892247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.892699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.893117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:44.938118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:44.938736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:44.947694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.948192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.948629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:44.949390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:44.949999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:44.950434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:45.085663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:45.093632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8173904f-efc7-4668-a2f4-31148f46d60d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.215526 Aug 22 15:59:45.094220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 57/124] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:44 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:45.118059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:45.127092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:45.129688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:45.130825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0655b09e-b47b-43ff-bcb8-6bc1bd29c67f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.196767 Aug 22 15:59:45.131426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 68/125] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:44 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:45.462427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:45.463038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:45.469340 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:45.469830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:45.470314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:45.471018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:45.471515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:45.471939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:45.614884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:45.622608 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-29eb36b0-a022-4dc7-91c3-a8f8fa03f2a5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.164314 Aug 22 15:59:45.623171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 58/126] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:45 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:45.773433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:45.773951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:45.779953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:45.780436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:45.780861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:45.781543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:45.781990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:45.782406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:45.911074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:45.918623 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-77e41258-a939-482b-9bd0-2a68ea303f9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.149149 Aug 22 15:59:45.919189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 69/127] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:45 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:46.114982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:46.115630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:46.121684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:46.122169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:46.122607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:46.123298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:46.123781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:46.124209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:46.153661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:46.154297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:46.160948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:46.161431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:46.161864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:46.162555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:46.163006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:46.163451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:46.311650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:46.319250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-766780a4-2637-4d16-94a2-d21fb75bdfee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.208638 Aug 22 15:59:46.322966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 59/128] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:46 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:46.337958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:46.346896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:46.348443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:46.349554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4d39ea9c-a6f0-4484-9143-1330f12a12aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.199751 Aug 22 15:59:46.350117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 70/129] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:46 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:46.643762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:46.644235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:46.650434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:46.650922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:46.651939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:46.652090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:46.652543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:46.652975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:46.784386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:46.792343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-387d90f5-ff62-47ee-a5e5-e6cb66f9683c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.153785 Aug 22 15:59:46.792914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 60/130] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:46 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:46.941182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:46.941859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:46.948170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:46.948661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:46.949105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:46.949800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:46.950250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:46.950672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:47.085230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:47.093522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d46a3a01-06be-4175-b5b0-0525726e68a9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.157520 Aug 22 15:59:47.093965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 71/131] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:46 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:47.339989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:47.340601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:47.346510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:47.346999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:47.347488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:47.348169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:47.348627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:47.349053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:47.372740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:47.373516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:47.380650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:47.381224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:47.381770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:47.382538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:47.383066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:47.383527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:47.695063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:47.702978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:47.706776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9ccc090b-f350-46cb-8f1f-2b9176ccff13 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.370730 Aug 22 15:59:47.714957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:47.718094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:47.719731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4d77d44c-95d5-447a-9dd4-27e4cf509eb2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.351140 Aug 22 15:59:47.720129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 61/132] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:47 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:47.735375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 72/133] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:47 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:47.814734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:47.815375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:47.827950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:47.828465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:47.829184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:47.830548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:47.831006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:47.831470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:48.116432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:48.117116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:48.133564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:48.134059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:48.134691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:48.135431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:48.135889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:48.136316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:48.199354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:48.210508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c0d62333-9427-475d-8624-62832b1b3bb7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.400217 Aug 22 15:59:48.211275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 62/134] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:47 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:48.420335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:48.432265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-07d05395-8f4b-4c4b-8a86-1a3b3f9cc6f7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.321660 Aug 22 15:59:48.432857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 73/135] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:48 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:48.613738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-292db506-044d-49eb-9148-de72b5998338 req-64c1c92d-a8d7-4c32-abe9-2bc213f54731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a6012e-3710-4ea5-9cfa-7e0e34321caf", "tag": "f9c81dc7-a34c-438c-8a49-f74d23ef8f2f"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:48.623223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-292db506-044d-49eb-9148-de72b5998338 req-64c1c92d-a8d7-4c32-abe9-2bc213f54731 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:48.623732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-292db506-044d-49eb-9148-de72b5998338 req-64c1c92d-a8d7-4c32-abe9-2bc213f54731 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:48.624162 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-292db506-044d-49eb-9148-de72b5998338 req-64c1c92d-a8d7-4c32-abe9-2bc213f54731 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:48.635599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-292db506-044d-49eb-9148-de72b5998338 req-64c1c92d-a8d7-4c32-abe9-2bc213f54731 service nova] Creating event network-changed:f9c81dc7-a34c-438c-8a49-f74d23ef8f2f for instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf on hv-cinder-85400 Aug 22 15:59:48.640576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-292db506-044d-49eb-9148-de72b5998338 req-64c1c92d-a8d7-4c32-abe9-2bc213f54731 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089805 Aug 22 15:59:48.641164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 63/136] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 15:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:48.729701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:48.730314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:48.737955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:48.738352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:48.738798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:48.739554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:48.739977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:48.740393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:48.746359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:48.747171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:48.755308 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:48.756006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:48.756680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:48.757699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:48.758381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:48.759071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:48.947382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:48.955751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6afcb856-dc7e-4b02-b15f-908755fe47b0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.229909 Aug 22 15:59:48.956432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 74/137] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:48 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:48.982500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:48.991870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:48.993650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:48.994778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-df43240d-d5e7-4eba-92af-fca88b78b0c7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.253178 Aug 22 15:59:48.995367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 64/138] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:48 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:49.234278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:49.235155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:49.241496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:49.241993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:49.242432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:49.243153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:49.243634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:49.244057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:49.385243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:49.411630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1bccd98c-fb5d-4e5f-ba6d-1bd2b937807d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.182318 Aug 22 15:59:49.412849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 75/139] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:49 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:49.455851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:49.457328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:49.466321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:49.467154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:49.467884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:49.468807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:49.469462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:49.470194 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:49.902675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:49.947460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6357ae6b-db80-444e-a569-58711be7a99b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.495423 Aug 22 15:59:49.950730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 65/140] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:49 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:49.979615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:49.980409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:49.993498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:49.997106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:49.997826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:49.999442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:50.002043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:50.004570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:50.020553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:50.021540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:50.052984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:50.054920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:50.056674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:50.058866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:50.059252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:50.060738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:50.062066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:50.395011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:50.402817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a209f667-8677-4b43-9b09-1d799eb5f0a5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.429452 Aug 22 15:59:50.403422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 76/141] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:49 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:50.436086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:50.437131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:50.437756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:50.443966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:50.444651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:50.444845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:50.445303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:50.446013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:50.446459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:50.447126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:50.447316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:50.448384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4b2bc699-e7a4-4015-926c-bb884fb86d8b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.434064 Aug 22 15:59:50.463677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 66/142] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:50 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:50.592661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:50.603505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a4468b4c-e7cf-445b-8cf4-8665132a0ff9 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.168796 Aug 22 15:59:50.603505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 77/143] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:50 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:50.976553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:50.977175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:50.983312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:50.983839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:50.984422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:50.985003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:50.985494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:50.985919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:51.121484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:51.130274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bce92f39-0f15-4a5d-b202-d08c71563618 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.157479 Aug 22 15:59:51.130901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 67/144] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:50 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:51.425840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:51.426485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:51.432570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:51.433055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:51.433495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:51.434190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:51.434643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:51.435083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:51.471172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:51.471838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:51.478474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:51.479172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:51.479771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:51.480327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:51.480801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:51.481268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:51.621946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:51.633034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8e1a12e2-5cab-43fa-8750-00bfc6436cbf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.210912 Aug 22 15:59:51.633034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 78/145] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:51 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:51.637719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:51.638835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:51.645866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:51.646624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:51.647102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:51.647978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:51.648580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:51.649094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:51.662406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:51.670468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:51.672014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:51.673179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1570e617-a1f2-403f-84be-2f20ad345825 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.205866 Aug 22 15:59:51.673741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 68/146] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:51 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:51.939615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:51.947308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-81e4cecb-d834-41be-9ac6-0cb0fadfebd8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.313192 Aug 22 15:59:51.947894 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 79/147] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:51 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:52.152957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:52.153570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:52.160199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:52.160684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:52.161123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:52.161866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:52.162272 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:52.162697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:52.298922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:52.307675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a79bddaf-3eea-4aa2-bcaf-dcd33df27a62 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.158723 Aug 22 15:59:52.308380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 69/148] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:52 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:52.653488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:52.654018 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:52.659955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:52.660433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:52.660871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:52.661552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:52.662000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:52.662420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:52.702924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:52.703744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:52.711307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:52.711899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:52.712247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:52.713217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:52.713762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:52.714193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:52.856201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:52.863856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b782988c-c72a-48b8-a09f-96a518dd8085 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.214216 Aug 22 15:59:52.864431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 80/149] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:52 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:52.882571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:52.890684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:52.892702 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:52.893798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e0d11217-7dd0-4458-90e4-c51f65868d41 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.201837 Aug 22 15:59:52.894345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 70/150] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:52 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:52.968206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:52.968769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:52.975319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:52.975843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:52.976285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:52.976972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:52.977426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:52.978134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:53.170340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:53.178146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c9a68e22-e6a6-4651-a304-0360883fbcbd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.213815 Aug 22 15:59:53.183923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 81/151] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:52 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:53.330346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:53.331108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:53.338038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:53.338514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:53.338935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:53.339671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:53.340117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:53.340531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:53.491188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:53.499637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-acdb2cf0-e877-417d-b6ef-74c7e294bc82 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.173742 Aug 22 15:59:53.500223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 71/152] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:53 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:53.884163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:53.885020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:53.891532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:53.892641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:53.893136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:53.893889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:53.894404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:53.894887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:53.917480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:53.918095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:53.924463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:53.924957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:53.925399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:53.926108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:53.926558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:53.927178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:54.101754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:54.109216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:54.109754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-321f5046-e1dd-4bef-a51f-37c1e51b0800 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.229470 Aug 22 15:59:54.110329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 82/153] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:53 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:54.117927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:54.119432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:54.120555 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b8a00925-2601-4d3f-9730-17d3c75f05b1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.206944 Aug 22 15:59:54.121095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 72/154] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:53 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 15:59:54.196011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:54.205196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:54.205986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:54.213254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:54.214498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:54.215254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:54.216130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:54.216727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:54.217303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:54.381664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:54.394651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4a10bdc8-f5c8-49b9-bde0-7e17ffb1fb7b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.199380 Aug 22 15:59:54.395210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 83/155] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:54 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:54.522034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:54.522930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:54.529109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:54.529599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:54.530042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:54.530746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:54.531206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:54.531667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:54.550881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:54.675078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:54.682700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eb773b46-760c-415f-9fd1-698e579d24e5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.165875 Aug 22 15:59:54.683275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 73/156] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:54 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:55.134078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:55.134866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:55.145001 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:55.146528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:55.154855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:55.155730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:55.156352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:55.157217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:55.157394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:55.157942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:55.158461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:55.158598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:55.159596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:55.160807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:55.161620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:55.162577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:55.459878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:55.471377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:55.478760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:55.481341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:55.484722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e77fbd42-2ba9-4001-9d27-4dde0976bec5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.343618 Aug 22 15:59:55.487371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-927caa61-7f32-4e64-ba7b-a85d11044711 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.360574 Aug 22 15:59:55.487806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 84/157] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:55 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:55.495625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 74/158] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:55 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:55.502669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:55.503365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:55.514800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:55.515296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:55.515779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:55.516494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:55.517541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:55.517971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:55.706988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:55.708855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:55.717569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:55.718348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:55.718993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:55.720573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:55.721328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:55.722006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:55.790194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:55.799019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-df90b127-3755-41db-851b-44db92891b73 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.310175 Aug 22 15:59:55.804003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 85/159] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:55 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:55.999904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:56.015962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-87893def-90b1-4f5c-a5b0-e7bae9c7ec65 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.314865 Aug 22 15:59:56.019067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 75/160] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:55 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:56.508975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:56.509585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:56.527363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:56.527846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:56.528346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:56.529125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:56.529579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:56.530011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:56.567649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-dffa2167-7f9f-44cf-aa70-804ba517a07b req-f03ada32-892d-45d4-984f-cbe62b9dd08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cbc6b6e-511f-4f80-8f1c-10fc819eb319", "name": "network-vif-plugged", "status": "completed", "tag": "cfed9e3e-cded-427a-b9ac-9070c083cfb4"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:56.596047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-dffa2167-7f9f-44cf-aa70-804ba517a07b req-f03ada32-892d-45d4-984f-cbe62b9dd08c service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:56.596807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-dffa2167-7f9f-44cf-aa70-804ba517a07b req-f03ada32-892d-45d4-984f-cbe62b9dd08c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:56.597414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-dffa2167-7f9f-44cf-aa70-804ba517a07b req-f03ada32-892d-45d4-984f-cbe62b9dd08c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:56.611667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-dffa2167-7f9f-44cf-aa70-804ba517a07b req-f03ada32-892d-45d4-984f-cbe62b9dd08c service nova] Creating event network-vif-plugged:cfed9e3e-cded-427a-b9ac-9070c083cfb4 for instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 on hv-cinder-85400 Aug 22 15:59:56.618908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-dffa2167-7f9f-44cf-aa70-804ba517a07b req-f03ada32-892d-45d4-984f-cbe62b9dd08c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147448 Aug 22 15:59:56.620147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 86/161] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 15:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:56.628632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:56.629617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:56.637218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:56.638001 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:56.638649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:56.639787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:56.640437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:56.640956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:56.737146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:56.749697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bd1b39e9-5897-41c6-b560-7b730b92d107 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.244983 Aug 22 15:59:56.750523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 76/162] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:56 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:56.825672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:56.826419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:56.836906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:56.837891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:56.838978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:56.840085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:56.840805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:56.841304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:56.847009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:56.855979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:56.857882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:56.859339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-30407b00-1689-4508-8c83-4d2d1b966633 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.237530 Aug 22 15:59:56.860498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 87/163] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:56 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:57.017214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:57.025574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6704a351-fcd1-4306-8c12-98d54cb56d14 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.205229 Aug 22 15:59:57.026259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 77/164] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:56 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:57.041853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:57.042753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:57.050343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:57.050834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:57.051479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:57.052250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:57.052658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:57.053084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:57.211412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:57.219774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ad92826a-3840-4df1-8c33-85b51fd29932 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.181708 Aug 22 15:59:57.220348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 88/165] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:57 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:57.774002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:57.775277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:57.783971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:57.784783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:57.785833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:57.787737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:57.788879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:57.789917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:57.881805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:57.882536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:57.888838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:57.889324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:57.889759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:57.890461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:57.891088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:57.891378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:57.961629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:57.971292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-442edcba-f9c2-4eec-bfa6-819e168729a9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.202367 Aug 22 15:59:57.972815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 78/166] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:57 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:58.047828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:58.048823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:58.056063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:58.056943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:58.057557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:58.058681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:58.059466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:58.060488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:58.077600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:58.091781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:58.093779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:58.095718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-92323d78-6ca8-4147-8e01-6c5e10912e9b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.218168 Aug 22 15:59:58.096892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 89/167] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:57 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:58.241549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:58.242794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:58.249858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:58.250714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:58.252025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:58.253087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:58.253776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:58.254216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:58.290335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:58.300100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-abcf9506-2596-4be9-a881-7f5b3b5b7ef4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.256144 Aug 22 15:59:58.300765 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 79/168] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:58 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:58.456668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:58.466317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d6a3d9fb-fbb3-4019-ad19-de04446ffa27 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.228693 Aug 22 15:59:58.480687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 90/169] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:58 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 15:59:58.723571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-2ba779e7-9e16-4ee9-88c5-237a56ef3913 req-8d0cf4fc-57cd-4f30-8f60-ef843bdd93a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e589fa-e174-4b10-a78f-dd18b10b90f5", "name": "network-vif-plugged", "status": "completed", "tag": "3dd65d89-d95c-47fa-9299-3a65992872b8"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 15:59:58.734465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2ba779e7-9e16-4ee9-88c5-237a56ef3913 req-8d0cf4fc-57cd-4f30-8f60-ef843bdd93a4 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:58.735241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2ba779e7-9e16-4ee9-88c5-237a56ef3913 req-8d0cf4fc-57cd-4f30-8f60-ef843bdd93a4 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:58.735852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2ba779e7-9e16-4ee9-88c5-237a56ef3913 req-8d0cf4fc-57cd-4f30-8f60-ef843bdd93a4 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:58.750868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-2ba779e7-9e16-4ee9-88c5-237a56ef3913 req-8d0cf4fc-57cd-4f30-8f60-ef843bdd93a4 service nova] Creating event network-vif-plugged:3dd65d89-d95c-47fa-9299-3a65992872b8 for instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 on hv-cinder-85400 Aug 22 15:59:58.756872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-2ba779e7-9e16-4ee9-88c5-237a56ef3913 req-8d0cf4fc-57cd-4f30-8f60-ef843bdd93a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038560 Aug 22 15:59:58.758192 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 80/170] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 15:59:58.993929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:58.996048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:59.021139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:59.022521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:59.023449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:59.024334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:59.025234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:59.026846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:59.120094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:59.120862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:59.128943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:59.129536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:59.130145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:59.131007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:59.131648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:59.132221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:59.424503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:59.428325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:59.437019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:59.439221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f92b63d-a6c8-4828-b9c8-2914bf7643f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.449258 Aug 22 15:59:59.440228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 91/171] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:58 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:59.445273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:59.446539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cf9c2a49-0170-4e7c-8ce9-74b38b540aec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.330895 Aug 22 15:59:59.448039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:59.448437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 81/172] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 15:59:59 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 15:59:59.448968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:59.459978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:59.460882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:59.461411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:59.462325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:59.463102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:59.463562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:59.492824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 15:59:59.496469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 15:59:59.515939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:59.516492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:59.517487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:59.518203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 15:59:59.518665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 15:59:59.519178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 15:59:59.726609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:59.741045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e85f1195-5005-43de-9aa6-18abfc4428df tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1367 microversion: 2.1 time: 0.297761 Aug 22 15:59:59.741936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 92/173] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:59 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 15:59:59.768557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 15:59:59.778548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d485359b-24e0-4bdd-9ab9-7c846c625f51 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.291075 Aug 22 15:59:59.779592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 82/174] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 15:59:59 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:00.461640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:00.462257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:00.468389 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:00.468962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:00.469372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:00.470677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:00.471128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:00.471743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:00.475809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:00.476427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:00.478854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=99 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:00.484428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:00.485117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:00.485615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:00.486328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:00.486784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:00.487269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:00.696580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:00.703368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:00.703712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:00.708734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a090b7da-699f-4fde-98b4-1e4045dc6dee tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.250268 Aug 22 16:00:00.709659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 93/175] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:00 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:00.722019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:00.722019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:00.722019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7703c651-7a24-4374-8b99-93091736c042 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.245708 Aug 22 16:00:00.722360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 83/176] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:00 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:00.763730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:00.763730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:00.770244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:00.770733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:00.771165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:00.771898 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:00.772346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:00.772767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:00.801082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:00.802035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:00.810052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:00.810540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:00.811206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:00.812094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:00.812695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:00.813899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:01.088163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:01.103235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:01.110679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-17b4a996-5849-448c-9a8a-1bdfb500c28b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.309318 Aug 22 16:00:01.111817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 94/177] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:00 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:01.121174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5fa2be45-f43f-4249-a90c-0790b0a4d953 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1558 microversion: 2.1 time: 0.361737 Aug 22 16:00:01.122296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 84/178] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:00 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1558 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:01.131883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-b773bb24-e6ab-48e4-96ee-411300586a8a req-725b5b55-71b6-4797-8c21-4344446fe228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6012e-3710-4ea5-9cfa-7e0e34321caf", "name": "network-vif-plugged", "status": "completed", "tag": "f9c81dc7-a34c-438c-8a49-f74d23ef8f2f"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:01.148960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:01.149721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:01.161160 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:01.163294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:01.164357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:01.165258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:01.168283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:01.168955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:01.175287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b773bb24-e6ab-48e4-96ee-411300586a8a req-725b5b55-71b6-4797-8c21-4344446fe228 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:01.178004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b773bb24-e6ab-48e4-96ee-411300586a8a req-725b5b55-71b6-4797-8c21-4344446fe228 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:01.181109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b773bb24-e6ab-48e4-96ee-411300586a8a req-725b5b55-71b6-4797-8c21-4344446fe228 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:01.249652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-b773bb24-e6ab-48e4-96ee-411300586a8a req-725b5b55-71b6-4797-8c21-4344446fe228 service nova] Creating event network-vif-plugged:f9c81dc7-a34c-438c-8a49-f74d23ef8f2f for instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf on hv-cinder-85400 Aug 22 16:00:01.269962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-b773bb24-e6ab-48e4-96ee-411300586a8a req-725b5b55-71b6-4797-8c21-4344446fe228 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153154 Aug 22 16:00:01.270467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 95/179] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:00:01.347713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-78a9e797-b171-4c5f-9d2c-a695273c8730 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203389 Aug 22 16:00:01.352227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 85/180] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 22 16:00:01 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:00:01.730260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:01.730965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:01.740312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:01.740932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:01.749607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:01.750190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:01.750531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:01.751855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:01.752316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:01.752744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:01.756883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:01.757379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:01.757994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:01.758719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:01.759673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:01.760194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:02.154728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:02.166487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6b7a55d1-18c4-4053-b9f8-65aca5f2640e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.440460 Aug 22 16:00:02.173788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 96/181] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:01 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:02.184330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:02.184983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:02.189908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:02.192681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:02.193939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:02.194588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:02.195633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:02.196656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:02.197305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:02.202656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:02.204474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:02.205914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dc72de89-9102-4c8d-84da-4a06dc53e4ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.469592 Aug 22 16:00:02.206654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 86/182] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:01 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:02.360994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:02.369106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-52de4d75-8508-4b0c-b9c2-bf004d92df9b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.194142 Aug 22 16:00:02.369933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 97/183] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:02 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:03.108101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-cf9a010a-4f34-4069-b1f2-7dcab89c11df req-21cdb651-3ad3-4fbf-aca7-c8c1c3e89328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cbc6b6e-511f-4f80-8f1c-10fc819eb319", "tag": "cfed9e3e-cded-427a-b9ac-9070c083cfb4"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:03.119255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-cf9a010a-4f34-4069-b1f2-7dcab89c11df req-21cdb651-3ad3-4fbf-aca7-c8c1c3e89328 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:03.119785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-cf9a010a-4f34-4069-b1f2-7dcab89c11df req-21cdb651-3ad3-4fbf-aca7-c8c1c3e89328 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:03.120397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-cf9a010a-4f34-4069-b1f2-7dcab89c11df req-21cdb651-3ad3-4fbf-aca7-c8c1c3e89328 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:03.133547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-cf9a010a-4f34-4069-b1f2-7dcab89c11df req-21cdb651-3ad3-4fbf-aca7-c8c1c3e89328 service nova] Creating event network-changed:cfed9e3e-cded-427a-b9ac-9070c083cfb4 for instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 on hv-cinder-85400 Aug 22 16:00:03.139141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-cf9a010a-4f34-4069-b1f2-7dcab89c11df req-21cdb651-3ad3-4fbf-aca7-c8c1c3e89328 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036341 Aug 22 16:00:03.140077 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 87/184] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:00:03.198734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:03.199727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:03.204960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:03.213160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:03.214013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:03.214775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:03.216204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:03.217039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:03.218123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:03.235739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:03.237740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:03.250256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:03.252477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:03.253628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:03.255261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:03.256635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:03.259134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:03.590815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:03.608049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:03.619181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-920199db-11de-4410-b41d-eb35b9973363 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.432105 Aug 22 16:00:03.619810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 98/185] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:03 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:03.620739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:03.622440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:03.625085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-aca62829-db79-4b4c-a52e-9f416042cabf tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.396548 Aug 22 16:00:03.635456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 88/186] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:03 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:03.635773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-7a68e0aa-7604-489b-b1ae-ea54b80c4261 req-041ab09b-2c29-49d4-bdf3-494b6c52f91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639501de-5f89-4426-b93c-0635a1caa0c6", "name": "network-vif-plugged", "status": "completed", "tag": "72b29b7d-7e2a-4947-9b67-66d1c3ca1834"}, {"server_uuid": "a9d17721-4fcc-449b-af1c-c80802160428", "name": "network-vif-plugged", "status": "completed", "tag": "be4edab1-bacb-43d0-8181-3d6691f0cef0"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:03.644003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:03.644773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:03.651446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:03.652206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:03.653001 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:03.653970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:03.654589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:03.655189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:03.662235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-7a68e0aa-7604-489b-b1ae-ea54b80c4261 req-041ab09b-2c29-49d4-bdf3-494b6c52f91a service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:03.662716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-7a68e0aa-7604-489b-b1ae-ea54b80c4261 req-041ab09b-2c29-49d4-bdf3-494b6c52f91a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:03.663154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-7a68e0aa-7604-489b-b1ae-ea54b80c4261 req-041ab09b-2c29-49d4-bdf3-494b6c52f91a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:03.683144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-7a68e0aa-7604-489b-b1ae-ea54b80c4261 req-041ab09b-2c29-49d4-bdf3-494b6c52f91a service nova] Creating event network-vif-plugged:72b29b7d-7e2a-4947-9b67-66d1c3ca1834 for instance 639501de-5f89-4426-b93c-0635a1caa0c6 on hv-cinder-85400 Aug 22 16:00:03.684640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-7a68e0aa-7604-489b-b1ae-ea54b80c4261 req-041ab09b-2c29-49d4-bdf3-494b6c52f91a service nova] Creating event network-vif-plugged:be4edab1-bacb-43d0-8181-3d6691f0cef0 for instance a9d17721-4fcc-449b-af1c-c80802160428 on hv-cinder-85400 Aug 22 16:00:03.695464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-7a68e0aa-7604-489b-b1ae-ea54b80c4261 req-041ab09b-2c29-49d4-bdf3-494b6c52f91a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074255 Aug 22 16:00:03.696374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 99/187] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:00:03.882181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:03.895216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dd06f00f-5907-4efa-bb14-90136e405d49 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.267544 Aug 22 16:00:03.896700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 89/188] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:03 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:04.640895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:04.648545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:04.649186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:04.650184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:04.659519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:04.662254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:04.666091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:04.667132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:04.667463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:04.668291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:04.668933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:04.669856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:04.670528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:04.671455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:04.673006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:04.673463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:05.008217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:05.010215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:05.017952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-31a01d5f-1f6c-43a0-9aa5-f9410de2f48f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.381221 Aug 22 16:00:05.032443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:05.032443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:05.032443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-450f6342-57c8-40e2-907f-ce56d0f6c930 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.378170 Aug 22 16:00:05.032687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 90/189] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:04 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:05.033638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 100/190] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:04 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:05.042974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:05.043679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:05.050911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:05.051538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:05.052052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:05.052862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:05.053386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:05.054027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:05.200434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:05.205119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:05.210817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-99b1fc63-acb2-42ad-be6f-963ccc6f1026 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.183342 Aug 22 16:00:05.211421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 91/191] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:05 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:06.039918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:06.045981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:06.047409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:06.049686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:06.076200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:06.077052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:06.077938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:06.079536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:06.080252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:06.080368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:06.081399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:06.082022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:06.082311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:06.083299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:06.083983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:06.086582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:06.387978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:06.406030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:06.411375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:06.412708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-08eb309b-223a-4285-a1c2-86f4d4b6273a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.370709 Aug 22 16:00:06.431891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 92/192] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:06 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:06.435177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:06.439375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:06.440455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:06.445666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-efe7f6e6-9c8f-49da-846f-1d74e79c3c66 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.410527 Aug 22 16:00:06.458738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:06.459251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:06.459658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 101/193] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:06 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:06.460991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:06.461816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:06.462207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:06.462864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:06.717360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:06.740228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-500fa28a-3004-409e-b675-7d5942aa6544 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.305694 Aug 22 16:00:06.741722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 93/194] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:06 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:07.439149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:07.440531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:07.448431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:07.448937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:07.449421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:07.450263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:07.450768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:07.451348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:07.484776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:07.486476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:07.512689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:07.516031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:07.516494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:07.517200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:07.517657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:07.518148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:07.705645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:07.720895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:07.722794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:07.724146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-84be7328-4871-4e9f-9484-4f78e2578ddb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.289062 Aug 22 16:00:07.732212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 102/195] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:07 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:07.762751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:07.763873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:07.771525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:07.772382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:07.772972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:07.773772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:07.774318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:07.774815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:07.787276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:07.802801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8098f04d-e4ef-45af-b2cb-abf280a62304 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.324510 Aug 22 16:00:07.804186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 94/196] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:07 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:08.018510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:08.031260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-27ef8fde-c684-4ce3-af82-f6a77acf3575 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.272326 Aug 22 16:00:08.032604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 103/197] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:07 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:08.749724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:08.751626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:08.758351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:08.759153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:08.759832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:08.761064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:08.761730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:08.762353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:08.827037 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:08.827921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:08.835754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:08.836397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:08.836809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:08.837515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:08.838056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:08.838485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:08.994662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:09.004364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:09.006231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:09.007661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cbb712a7-8ae4-48be-ba6d-f4985ccf57e4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.263491 Aug 22 16:00:09.008678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 95/198] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:08 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:09.044467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:09.052836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-38b83e75-58d8-4e62-9bd3-93b631a817ce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.229784 Aug 22 16:00:09.053277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:09.063464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 104/199] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:08 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:09.064150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:09.064150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:09.064150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:09.064150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:09.064470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:09.064470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:09.064470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:09.222712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:09.231087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-18f5c7a4-46b0-4ea0-94fa-b577097da6ea tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1315 microversion: 2.1 time: 0.183405 Aug 22 16:00:09.231719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 96/200] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:09 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:10.037072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:10.041982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:10.080589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:10.086531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:10.087304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:10.088733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:10.100808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:10.105850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:10.107265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:10.111279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:10.115011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:10.116227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:10.117145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:10.118570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:10.121576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:10.126331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:10.443644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:10.458942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:10.460180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7fcae689-1338-420d-8bb2-6ad2b4208a78 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1321 microversion: 2.1 time: 0.387931 Aug 22 16:00:10.460957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 97/201] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:10 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:10.471977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:10.473227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:10.477298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ab553a8b-7174-42b1-b826-54a1b64c9327 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1406 microversion: 2.20 time: 0.445636 Aug 22 16:00:10.477298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 105/202] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:10 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:10.482282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:10.483836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:10.500988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:10.501750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:10.502344 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:10.503584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:10.504244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:10.504824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:10.682384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:10.696159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1622e313-86c7-4c27-abcc-049ccc9ec6ed tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1502 microversion: 2.1 time: 0.222179 Aug 22 16:00:10.696898 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 98/203] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:10 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:11.486053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:11.486835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:11.492979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:11.493464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:11.493899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:11.496292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:11.496292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:11.496292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:11.512010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:11.513178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:11.521495 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:11.522291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:11.522896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:11.523808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:11.524443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:11.525036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:11.748185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:11.754164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:11.773618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:11.775724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:11.778052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9831458e-a06e-44d7-b0cd-042d93a65829 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1599 microversion: 2.20 time: 0.280413 Aug 22 16:00:11.783418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 99/204] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:00:11 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1599 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:00:11.783907 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6375b694-4bde-488a-b7df-6d28b3e7388e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1514 microversion: 2.1 time: 0.302244 Aug 22 16:00:11.784733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 106/205] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:11 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:11.805277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:11.805845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:11.808831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:11.811834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:11.820086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:11.820852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:11.821507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:11.822617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:11.822759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:11.823614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:11.823817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:11.824531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:11.824709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:11.826831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:11.827749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:11.829967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:11.901111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lazy-loading 'flavor' on Instance uuid a9d17721-4fcc-449b-af1c-c80802160428 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:00:11.960858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-85c91a0b-7e1f-42d8-998b-19c7c2e68b66 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160437 Aug 22 16:00:11.961543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 100/206] 10.222.0.40 () {60 vars in 1316 bytes} [Mon Aug 22 16:00:11 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 16:00:12.109502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-089a73df-5709-45eb-8571-a91f6a0b5456 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428/action" status: 200 len: 32 microversion: 2.1 time: 0.304711 Aug 22 16:00:12.111023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 107/207] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:00:11 2022] POST /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428/action => generated 32 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 16:00:12.125746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:12.126688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:12.137413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:12.137988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:12.138442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:12.139195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:12.139744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:12.140318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:12.519060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d5069e1-172c-4087-8fa6-7d623b8a7f43"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:12.527881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:12.565267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:12.566653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:12.570363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:12.575897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:12.580105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:12.584297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:12.660785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:12.681278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1af568dd-335b-4410-b7a8-2711376bbede tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.564486 Aug 22 16:00:12.681887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 101/208] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:12 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:13.444576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:13.488943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-db4965e8-d525-4e61-8794-7bbcf9948a68 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "POST /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.988337 Aug 22 16:00:13.489599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 108/209] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:00:12 2022] POST /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6/os-volume_attachments => generated 194 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:00:13.722848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:13.723482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:13.734195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:13.736892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:13.742247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:13.743483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:13.744177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:13.744829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:14.234888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:14.244098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-696a58e3-f74d-4fbe-9072-73150227dbbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.526357 Aug 22 16:00:14.245091 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 102/210] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:13 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:14.756218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-29a8f689-cc46-4c9d-8bbb-6b7848d4be0d req-167f1dd3-f76d-4f9e-b150-200a6d78dc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a6012e-3710-4ea5-9cfa-7e0e34321caf", "tag": "f9c81dc7-a34c-438c-8a49-f74d23ef8f2f"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:14.789742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-29a8f689-cc46-4c9d-8bbb-6b7848d4be0d req-167f1dd3-f76d-4f9e-b150-200a6d78dc9a service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:14.790912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-29a8f689-cc46-4c9d-8bbb-6b7848d4be0d req-167f1dd3-f76d-4f9e-b150-200a6d78dc9a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:14.791965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-29a8f689-cc46-4c9d-8bbb-6b7848d4be0d req-167f1dd3-f76d-4f9e-b150-200a6d78dc9a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:14.830107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-29a8f689-cc46-4c9d-8bbb-6b7848d4be0d req-167f1dd3-f76d-4f9e-b150-200a6d78dc9a service nova] Creating event network-changed:f9c81dc7-a34c-438c-8a49-f74d23ef8f2f for instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf on hv-cinder-85400 Aug 22 16:00:14.849951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-29a8f689-cc46-4c9d-8bbb-6b7848d4be0d req-167f1dd3-f76d-4f9e-b150-200a6d78dc9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106610 Aug 22 16:00:14.854654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 109/211] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:00:15.268292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:15.269597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:15.285090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:15.286487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:15.288084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:15.289820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:15.292447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:15.293711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:15.872502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:15.893235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6b2f94c9-f2e1-4cbd-b8fa-365040dbccfd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.629488 Aug 22 16:00:15.895501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 103/212] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:15 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:16.934239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:16.936878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:16.953185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:16.955011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:16.955820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:16.957717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:16.958806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:16.959655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:17.161643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:17.171881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a9a3085b-0729-4536-a6b1-227978fc62d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.249851 Aug 22 16:00:17.173333 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 110/213] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:16 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:18.193273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:18.193904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:18.200274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:18.200763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:18.201195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:18.201890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:18.202339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:18.202751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:18.345811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:18.354151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a1acbd35-39d0-42dd-9b48-77f6e45f19ed tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.164793 Aug 22 16:00:18.354736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 104/214] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:18 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:19.374770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:19.376030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:19.383072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:19.383607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:19.384042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:19.384784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:19.385216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:19.385632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:19.537432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:19.547308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-124b2ef9-1054-4059-82b1-1aa6d49beaf5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.176403 Aug 22 16:00:19.547888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 111/215] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:19 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:20.573282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:20.574372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:20.588831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:20.589739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:20.590570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:20.591901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:20.592749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:20.593769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:20.790553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:20.799039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1d73f7a2-00e6-44e9-9b7e-b8dd58302461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.234011 Aug 22 16:00:20.799675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 105/216] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:20 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:21.825446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:21.826189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:21.833220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:21.833700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:21.834326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:21.835118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:21.835500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:21.835933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:21.996323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:22.016374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2cf0a70b-1840-4d10-9e3c-b73993831cad tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.194127 Aug 22 16:00:22.029457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 112/217] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:21 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:23.050271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:23.051880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:23.059720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:23.060374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:23.061151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:23.063267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:23.063639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:23.064367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:23.294901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:23.312857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-164c40c3-a46e-46ce-b169-f6bae5101438 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.265654 Aug 22 16:00:23.314825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 106/218] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:23 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:23.705099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:23.705745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:23.712807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:23.715408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:23.716345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:23.717256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:23.718477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:23.720819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:23.758757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:00:23.870351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1057462f-aaf5-4cb6-a451-bfc354f784f9 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "DELETE /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 204 len: 0 microversion: 2.1 time: 0.168521 Aug 22 16:00:23.871409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 113/219] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:00:23 2022] DELETE /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:00:23.881444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:23.882341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:23.889511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:23.891514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:23.892155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:23.893263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:23.894377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:23.895185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:24.066041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:24.076795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ea0cc7a6-ae9d-41ab-8ed5-1117b57aa853 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1554 microversion: 2.1 time: 0.200519 Aug 22 16:00:24.079031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 107/220] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:23 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:24.345468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:24.346362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:24.354665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:24.355529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:24.356315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:24.356921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:24.357609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:24.358260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:24.573475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:24.586464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c79a2cfb-3021-44db-ba85-fba1f47e79e0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.247740 Aug 22 16:00:24.587850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 114/221] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:24 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:25.100599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:25.101325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:25.109799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:25.110695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:25.111266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:25.112224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:25.112811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:25.113354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:25.274309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:25.279725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:25.286392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1a23a207-a65b-45ba-ac90-8ad37ddc8d9f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1554 microversion: 2.1 time: 0.190647 Aug 22 16:00:25.287193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 108/222] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:25 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:25.610066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:25.611280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:25.617835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:25.618516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:25.619111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:25.620007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:25.620642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:25.621219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:25.854944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:25.863901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7ad84099-3b7b-469f-8a7f-706c20ec1b9e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.257608 Aug 22 16:00:25.864836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 115/223] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:25 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:26.309006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:26.311521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:26.323995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:26.324941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:26.325638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:26.326769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:26.327411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:26.328128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:26.519844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:26.530427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c4e80f88-6551-4536-b168-da21b38c91e7 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1554 microversion: 2.1 time: 0.226753 Aug 22 16:00:26.531720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 109/224] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:26 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:26.886805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:26.888311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:26.897434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:26.898440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:26.899168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:26.900164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:26.900936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:26.901744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:27.050446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:27.065132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6cf13aeb-d3f2-473a-bf2a-de37c543b03f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.183034 Aug 22 16:00:27.067149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 116/225] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:26 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:27.563224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:27.565245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:27.581209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:27.583833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:27.584912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:27.588811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:27.589993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:27.591027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:27.901962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:27.915030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b2ff9e71-a4d0-46c6-be5d-b93d8bcf3a60 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1554 microversion: 2.1 time: 0.361693 Aug 22 16:00:27.916151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 110/226] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:27 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1554 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:28.095722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-1e817e8c-2cad-4c92-8995-12c2da9a50bc req-124ab791-ca2d-4bc7-a725-bb8ad22aa646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639501de-5f89-4426-b93c-0635a1caa0c6", "name": "network-vif-deleted", "tag": "72b29b7d-7e2a-4947-9b67-66d1c3ca1834"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:28.097667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:28.098425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:28.106956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:28.108266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:28.109883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:28.112461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:28.113165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:28.115108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:28.138386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1e817e8c-2cad-4c92-8995-12c2da9a50bc req-124ab791-ca2d-4bc7-a725-bb8ad22aa646 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:28.140073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1e817e8c-2cad-4c92-8995-12c2da9a50bc req-124ab791-ca2d-4bc7-a725-bb8ad22aa646 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:28.141072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1e817e8c-2cad-4c92-8995-12c2da9a50bc req-124ab791-ca2d-4bc7-a725-bb8ad22aa646 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:28.163170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-1e817e8c-2cad-4c92-8995-12c2da9a50bc req-124ab791-ca2d-4bc7-a725-bb8ad22aa646 service nova] Creating event network-vif-deleted:72b29b7d-7e2a-4947-9b67-66d1c3ca1834 for instance 639501de-5f89-4426-b93c-0635a1caa0c6 on hv-cinder-85400 Aug 22 16:00:28.168860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-1e817e8c-2cad-4c92-8995-12c2da9a50bc req-124ab791-ca2d-4bc7-a725-bb8ad22aa646 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082618 Aug 22 16:00:28.169572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 117/227] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:00:28.283988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:28.294417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5dab1f90-bfe3-40ac-8064-f0dbe7ed246e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.207009 Aug 22 16:00:28.296018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 111/228] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:28 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:28.937553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:28.938259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:28.952660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:28.953893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:28.954514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:28.955224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:28.955713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:28.956142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:29.049516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:29.058696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4457ff7b-1938-42d2-916e-4c62c842446d tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1346 microversion: 2.1 time: 0.125098 Aug 22 16:00:29.073557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 118/229] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:28 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1346 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:29.318839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:29.319707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:29.326412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:29.326912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:29.327351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:29.328650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:29.329103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:29.329530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:29.482145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:29.490657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1250c29b-2201-4434-b7a6-3d3091f6bfb0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.176812 Aug 22 16:00:29.491267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 112/230] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:29 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:30.081357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:30.081973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:30.088952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:30.089434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:30.089874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:30.090654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:30.091014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:30.091500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:30.159974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:30.169165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-65efbd18-c73d-440c-9821-c5126bd09bb5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1346 microversion: 2.1 time: 0.092257 Aug 22 16:00:30.182715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 119/231] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:30 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:30.513205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:30.513956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:30.516120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=60 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:30.523357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:30.523882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:30.524532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:30.525332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:30.525804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:30.526255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:30.719981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:30.727931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6b03ab99-03e2-4fef-a746-9f95e0449e8d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.218740 Aug 22 16:00:30.728512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 113/232] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:30 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:31.189884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:31.191067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:31.198024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:31.198523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:31.198964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:31.199732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:31.200190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:31.200625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:31.274888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:31.286848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b9687a91-8212-43a3-8ac6-df66f5c11ef5 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1346 microversion: 2.1 time: 0.100281 Aug 22 16:00:31.287851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 120/233] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:31 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:31.749105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:31.749722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:31.755961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:31.756468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:31.756906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:31.757605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:31.758054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:31.758475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:31.924331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:31.932655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a933d2d0-da0f-4824-826d-3e2c7eeda327 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.187338 Aug 22 16:00:31.933943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 114/234] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:31 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:32.312793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:32.313520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:32.320943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:32.322094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:32.322699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:32.323619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:32.324225 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:32.324978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:32.362792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:32.363500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:32.364255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:32.364887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lazy-loading 'fault' on Instance uuid 639501de-5f89-4426-b93c-0635a1caa0c6 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:00:32.464242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da60563ae9704576bf10467b23ac9271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867033dda17c45ac9bf0253619b945cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:32.473647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ed5550c8-8e86-485b-acb0-7bf64c8b4808 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 200 len: 1351 microversion: 2.1 time: 0.167462 Aug 22 16:00:32.474450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 121/235] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:32 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 1351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:32.958849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:32.959649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:32.966169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:32.966776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:32.967474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:32.968315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:32.968974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:32.969674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:33.213219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:33.224888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2c82a57b-755a-4ada-8ac6-d613e9d8808a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.271971 Aug 22 16:00:33.239216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 115/236] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:32 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:33.499073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:33.501281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:33.516622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:33.522323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:33.523498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:33.525050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:33.526420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:33.527241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:33.528076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:33.560565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] HTTP exception thrown: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Request method failure captured: Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 HTTP/1.1 Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fRvsD-j_aSvIeuqBOb4WcsTZJRMV_W0jbAnoNVXzls9yFnRx2ehBhSlkuPmvNR9maEwc5HWFZlBCLcStILUiRv-u1gUX8q5WM5cb1R8H6b6CSXrTijASymR2bL06BVJnX3JLfTYehHcRU6ov8FcSNBNID77gKvz-h0KbepodPtTFo Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 867033dda17c45ac9bf0253619b945cc Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:00:33.565942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/867033dda17c45ac9bf0253619b945cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_867033dda17c45ac9bf0253619b945cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/867033dda17c45ac9bf0253619b945cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/867033dda17c45ac9bf0253619b945cc"}]}] Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 867033dda17c45ac9bf0253619b945cc Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-DeleteServersTestJSON-654345426-project Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: da60563ae9704576bf10467b23ac9271 Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-DeleteServersTestJSON-654345426-project Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.567201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '639501de-5f89-4426-b93c-0635a1caa0c6'} Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:00:33.567924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.569125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.570126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Returning 404 to user: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:00:33.570126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5d188487-a880-488a-a9e9-301249ae6c3b tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 404 len: 111 microversion: 2.1 time: 0.075130 Aug 22 16:00:33.570126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 122/237] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:33 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:33.722923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:33.725593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:33.733165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:33.733983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:33.734628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:33.735605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:33.736232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:33.737008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:33.754323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] HTTP exception thrown: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Request method failure captured: Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6/os-volume_attachments HTTP/1.1 Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fRvsD-j_aSvIeuqBOb4WcsTZJRMV_W0jbAnoNVXzls9yFnRx2ehBhSlkuPmvNR9maEwc5HWFZlBCLcStILUiRv-u1gUX8q5WM5cb1R8H6b6CSXrTijASymR2bL06BVJnX3JLfTYehHcRU6ov8FcSNBNID77gKvz-h0KbepodPtTFo Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 867033dda17c45ac9bf0253619b945cc Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:00:33.758911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/867033dda17c45ac9bf0253619b945cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_867033dda17c45ac9bf0253619b945cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/867033dda17c45ac9bf0253619b945cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/867033dda17c45ac9bf0253619b945cc"}]}] Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 867033dda17c45ac9bf0253619b945cc Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-DeleteServersTestJSON-654345426-project Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: da60563ae9704576bf10467b23ac9271 Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-DeleteServersTestJSON-654345426-project Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.768452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'server_id': '639501de-5f89-4426-b93c-0635a1caa0c6'} Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:00:33.769912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:33.771831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:33.773324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Returning 404 to user: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:00:33.773324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0a9dfe9f-eeb0-4c5f-a9fe-73cee9a07d19 tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043990 Aug 22 16:00:33.773324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 116/238] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:00:33 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:34.252104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:34.252104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:34.256873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:34.257545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:34.258312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:34.259363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:34.259986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:34.261497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:34.617117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:34.629179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a4df6e14-5e86-4bb3-8e11-8994d2587057 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.386224 Aug 22 16:00:34.629768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 123/239] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:34 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:35.650545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:35.651254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:35.663742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:35.664264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:35.664708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:35.665498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:35.665902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:35.666310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:35.846907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:35.855896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3e7b2c77-0f59-4869-bb22-0ae506bea588 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.209226 Aug 22 16:00:35.856652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 117/240] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:35 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:36.881595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:36.883811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:36.896533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:36.897376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:36.898102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:36.899456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:36.900896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:36.901699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:37.095785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:37.116450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-67e34ab9-5273-42c3-8a62-db2e91b22b14 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.242433 Aug 22 16:00:37.117895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 124/241] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:36 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:37.171004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:37.172419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:37.179914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:37.180636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:37.181710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:37.183146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:37.184574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:37.186184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:37.225066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] HTTP exception thrown: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Request method failure captured: Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 HTTP/1.1 Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fRvsD-j_aSvIeuqBOb4WcsTZJRMV_W0jbAnoNVXzls9yFnRx2ehBhSlkuPmvNR9maEwc5HWFZlBCLcStILUiRv-u1gUX8q5WM5cb1R8H6b6CSXrTijASymR2bL06BVJnX3JLfTYehHcRU6ov8FcSNBNID77gKvz-h0KbepodPtTFo Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 867033dda17c45ac9bf0253619b945cc Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:00:37.227203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/867033dda17c45ac9bf0253619b945cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_867033dda17c45ac9bf0253619b945cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/867033dda17c45ac9bf0253619b945cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/867033dda17c45ac9bf0253619b945cc"}]}] Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 867033dda17c45ac9bf0253619b945cc Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-DeleteServersTestJSON-654345426-project Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: da60563ae9704576bf10467b23ac9271 Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-DeleteServersTestJSON-654345426-project Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.228918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '639501de-5f89-4426-b93c-0635a1caa0c6'} Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:00:37.230273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.231683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.233355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Returning 404 to user: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:00:37.233355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1bd5130a-bd51-4327-bd57-98eae006a2ad tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "DELETE /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 404 len: 111 microversion: 2.1 time: 0.061645 Aug 22 16:00:37.233355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 118/242] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:00:37 2022] DELETE /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:37.238247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:37.238999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] [instance: 639501de-5f89-4426-b93c-0635a1caa0c6] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:37.245561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:37.246051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:37.246489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:37.247182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:37.247662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:37.248086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:37.254400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:37.266442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] HTTP exception thrown: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Request method failure captured: Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 HTTP/1.1 Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fRvsD-j_aSvIeuqBOb4WcsTZJRMV_W0jbAnoNVXzls9yFnRx2ehBhSlkuPmvNR9maEwc5HWFZlBCLcStILUiRv-u1gUX8q5WM5cb1R8H6b6CSXrTijASymR2bL06BVJnX3JLfTYehHcRU6ov8FcSNBNID77gKvz-h0KbepodPtTFo Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 867033dda17c45ac9bf0253619b945cc Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:00:37.268012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/867033dda17c45ac9bf0253619b945cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_867033dda17c45ac9bf0253619b945cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/867033dda17c45ac9bf0253619b945cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/867033dda17c45ac9bf0253619b945cc"}]}] Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 867033dda17c45ac9bf0253619b945cc Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-DeleteServersTestJSON-654345426 Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-DeleteServersTestJSON-654345426-project Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: da60563ae9704576bf10467b23ac9271 Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-DeleteServersTestJSON-654345426-project Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.269544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '639501de-5f89-4426-b93c-0635a1caa0c6'} Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:00:37.270418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. Aug 22 16:00:37.272133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:00:37.273577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] Returning 404 to user: Instance 639501de-5f89-4426-b93c-0635a1caa0c6 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:00:37.273577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6c24c40a-7b21-454f-9b50-cf709979e49f tempest-DeleteServersTestJSON-654345426 tempest-DeleteServersTestJSON-654345426-project] 10.222.0.40 "GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6" status: 404 len: 111 microversion: 2.1 time: 0.035880 Aug 22 16:00:37.273826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 125/243] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:37 2022] GET /compute/v2.1/servers/639501de-5f89-4426-b93c-0635a1caa0c6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:38.142183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:38.144148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:38.151368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:38.152549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:38.153343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:38.154399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:38.154861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:38.155498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:38.367596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:38.390997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4c14377c-5962-477a-a7be-3de4f7c12042 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.253493 Aug 22 16:00:38.393143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 119/244] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:38 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:00:39.434567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:39.436060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:39.453158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:39.454099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:39.454705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:39.455666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:39.456287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:39.456888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:40.029456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:40.076941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-338171dc-1756-413a-bc3a-ffef39e87e95 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.633464 Aug 22 16:00:40.079660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 126/245] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:39 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:41.109945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:41.115029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:41.138046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:41.138543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:41.138989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:41.139845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:41.140312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:41.140746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:41.755673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:41.765114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-be282f79-6e0d-42eb-8f94-f4c26e1a2e5f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.665670 Aug 22 16:00:41.779790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 120/246] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:41 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:42.791373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:42.793438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:42.822851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:42.823979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:42.825218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:42.829457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:42.830659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:42.831558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:43.391304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:43.403482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-123a0c85-c7bf-4c35-af8b-01471118c462 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.619224 Aug 22 16:00:43.408922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 127/247] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:42 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:44.446301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:44.448387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:44.459908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:44.461013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:44.462940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:44.465828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:44.466855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:44.467841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:44.745197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:44.758729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-48d3036b-5ad4-4b95-b695-39c2306d1a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1520 microversion: 2.1 time: 0.323299 Aug 22 16:00:44.759912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 121/248] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:44 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:45.792853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:45.793489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:45.803558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:45.803558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:45.803558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:45.804643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:45.804643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:45.804913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:46.046359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:46.059819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c2ad1316-3e6e-4bb2-9d38-0010bcd309a6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1500 microversion: 2.1 time: 0.270973 Aug 22 16:00:46.061116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 128/249] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:45 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1500 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:46.096140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:46.097030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:46.106109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:46.106852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:46.107443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:46.108961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:46.110694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:46.110694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:46.400595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:46.419160 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-39d1a099-57c2-4b1d-b2f1-9e112e67a96e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1514 microversion: 2.1 time: 0.330260 Aug 22 16:00:46.420761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 122/250] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:46 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:48.366416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:48.371635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:48.393457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:48.398119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:48.401564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:48.403703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:48.404785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:48.406729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:48.476396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lazy-loading 'flavor' on Instance uuid 91e589fa-e174-4b10-a78f-dd18b10b90f5 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:00:48.634991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-20a38ead-cb89-42d0-81fe-763c430f53f1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5/action" status: 200 len: 32 microversion: 2.1 time: 0.278360 Aug 22 16:00:48.637084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 129/251] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:00:48 2022] POST /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 16:00:48.656212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:48.658648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:48.675437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:48.677035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:48.677805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:48.681435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:48.683448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:48.685549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:49.075931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:49.105094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8b25cec7-b96f-4779-b418-3e7a1a1dbabf tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.461716 Aug 22 16:00:49.105865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 123/252] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:48 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:50.134711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:50.137294 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:50.150064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:50.151429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:50.152504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:50.154100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:50.155636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:50.156451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:50.455440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:50.482976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-37fefbc1-7c7e-4708-9536-203e21bd656e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.357735 Aug 22 16:00:50.504151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 130/253] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:50 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:51.531627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:51.534085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:51.545248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:51.546690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:51.547407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:51.548942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:51.549667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:51.550322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:51.845362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:51.856768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0da7d68d-7b28-4f35-909c-da126c2550d2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.331176 Aug 22 16:00:51.857447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 124/254] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:51 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:52.883293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:52.884199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:52.898765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:52.899564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:52.900171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:52.901091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:52.901716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:52.902307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:53.114632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:53.125992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16f26309-71e4-4221-a4cc-edf2e6863538 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.246900 Aug 22 16:00:53.132030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 131/255] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:52 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:54.150564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:54.151645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:54.163082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:54.164561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:54.165613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:54.167118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:54.168156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:54.169080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:54.432637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:54.454460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8cee4f78-e9d9-4e74-b892-d755fb51a5c9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.311080 Aug 22 16:00:54.455835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 125/256] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:54 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:55.478645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:55.480432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:55.488734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f7e40822-53b5-483d-a706-62fe682bf94e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'create', calling method: .version_select at 0x7fec9c407c10>, body: {"keypair": {"name": "tempest-keypair-420322041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE62mBf7WKkLB2n/cfAMTzas14P0IHEy7rqQybxeKxaelTFVflkihUTP7x0PicTe1doD7ezA60Y3Y0L2dr/SNlIkS7ZNTB2kKC2ACHE9ovKYUvHU3ft9UJoEhmy5hOkyuQ=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:55.497694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:55.502829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:55.503601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:55.509331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:55.511177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:55.512846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:55.530482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=95 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:55.547196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-f7e40822-53b5-483d-a706-62fe682bf94e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Getting quotas for project 1440505c4e8e45918dcfaa217afe59bc. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:00:55.572797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-f7e40822-53b5-483d-a706-62fe682bf94e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Getting quotas for user 244fd44e53dd4b1986abb6e4acba632b and project 1440505c4e8e45918dcfaa217afe59bc. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:00:55.655055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f7e40822-53b5-483d-a706-62fe682bf94e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.448538 Aug 22 16:00:55.664233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 132/257] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:00:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:00:56.100447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:56.111672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-38bda2e6-5a2a-4d5e-9aa2-31aece028f34 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.638212 Aug 22 16:00:56.127922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 126/258] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:55 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:57.140983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:57.146983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:57.183569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:57.184608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:57.185501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:57.188237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:57.192977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:57.196276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:57.880744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:57.894565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-92a225bb-f54f-4a5b-b56b-ba783d9af475 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.765703 Aug 22 16:00:57.896559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 133/259] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:57 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:58.936499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:00:58.937647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:00:58.958302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:58.964641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:58.965185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:58.966900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:00:58.969858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:00:58.970416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:00:59.479802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:00:59.513781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-13af79a0-c092-4220-8a91-99d4b010ea7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.585814 Aug 22 16:00:59.529371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 127/260] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:00:58 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:00:59.581367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-234893003", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50705536-805a-44d1-94d4-bf13bcaa804c"}], "security_groups": [{"name": "tempest-securitygroup--306226876"}], "key_name": "tempest-keypair-420322041", "user_data": "}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:00:59.808183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] validate_networks() for [('50705536-805a-44d1-94d4-bf13bcaa804c', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:01:00.547560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:00.550063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:00.571266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=30 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:00.576492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:00.578975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:00.580988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:00.583320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:00.584559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:00.585838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:01.359796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:01:01.361215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:01:01.361846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:01.362316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:01:01.363306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:01:01.363762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:01:01.370375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b176ad94-4063-40ef-a75f-0a475f0d4825 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.836946 Aug 22 16:01:01.374844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:01.375735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:01.376357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:01.377388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:01.378001 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:01.378576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:01.384904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 128/261] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:00 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:01.400087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Getting quotas for project 1440505c4e8e45918dcfaa217afe59bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:01:01.411578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Getting quotas for user 244fd44e53dd4b1986abb6e4acba632b and project 1440505c4e8e45918dcfaa217afe59bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:01:01.435112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:01:01.440537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:01:01.528114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6a81be4b-358a-46e8-97e3-fe52cc2f05c1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.951643 Aug 22 16:01:01.528778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 134/262] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:00:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 16:01:01.545525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-01fc53cb-d3c6-4c63-ab6f-ad4d46c86a28 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:01.546465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-01fc53cb-d3c6-4c63-ab6f-ad4d46c86a28 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:01.670767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-01fc53cb-d3c6-4c63-ab6f-ad4d46c86a28 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:01.682576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-01fc53cb-d3c6-4c63-ab6f-ad4d46c86a28 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1236 microversion: 2.1 time: 0.146104 Aug 22 16:01:01.698728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 129/263] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:01 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1236 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:02.180128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:02.184153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:02.202593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:02.203654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:02.204858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:02.208492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:02.209265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:02.209899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:02.304168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fb99a6b5-ae0c-4ead-acfa-d260d37386b6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/ips" status: 200 len: 151 microversion: 2.1 time: 0.153062 Aug 22 16:01:02.306187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 135/264] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 16:01:02 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/ips => generated 151 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:02.393711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:02.394351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:02.412020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:02.414112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:02.415591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:02.417989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:02.419614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:02.421499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:02.726809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:02.730477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:02.772838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:02.773678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:02.774417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:02.775801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:02.776614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:02.778024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:02.998996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:03.016730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f7a39b9a-76ed-4776-8ecc-6c6f7eca1a26 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.627787 Aug 22 16:01:03.028516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 130/265] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:02 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:03.045679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:03.073843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6ac3b0e6-74e3-49d5-b437-6f0aa6274977 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1232 microversion: 2.1 time: 0.363945 Aug 22 16:01:03.084443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 136/266] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:02 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1232 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:04.068357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:04.070483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:04.119602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:04.126750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:04.127429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:04.127894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:04.129105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:04.132878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:04.135499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:04.135873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:04.136049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:04.156963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:04.157465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:04.157910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:04.158648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:04.159116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:04.168163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:04.411559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:04.432804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-edddd188-52d9-4c55-a9eb-4573644babf6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1306 microversion: 2.1 time: 0.322915 Aug 22 16:01:04.434710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 137/267] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:04 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:04.446832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc51a1ed-444c-493e-b0a1-fb6eb0a9082f"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:04.452568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:04.463693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:04.464371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:04.464704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:04.465456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:04.465932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:04.466353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:04.634324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:04.650211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bfc9937f-9687-4bd9-851a-4ec42308a19a tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.590503 Aug 22 16:01:04.656587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 131/268] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:04 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:05.046390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-58a53301-0464-4d80-a590-1668241ff452 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.608707 Aug 22 16:01:05.047256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 138/269] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:01:04 2022] POST /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:05.466911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:05.468208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:05.480439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:05.481447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:05.482973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:05.484394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:05.486450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:05.487088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:05.644917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:05.663768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-731bb100-bd94-4568-a8e6-10c57a1975f8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1294 microversion: 2.1 time: 0.208848 Aug 22 16:01:05.664774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 132/270] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:05 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:05.685140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:05.687226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:05.699153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:05.700047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:05.700829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:05.704803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:05.705811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:05.706575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:06.483843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:06.496114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3558d327-135c-49e7-8f9b-bc184cec329e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.819118 Aug 22 16:01:06.496712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 139/271] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:05 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:06.698214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:06.701486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:06.721615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:06.722429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:06.723080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:06.724424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:06.725034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:06.728217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:07.078657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:07.094116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f5a2ed11-320a-4aec-903a-32f56caf4beb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1361 microversion: 2.1 time: 0.407861 Aug 22 16:01:07.099941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 133/272] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:06 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:07.531321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:07.534142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:07.544565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:07.545779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:07.547423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:07.548375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:07.548965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:07.549544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:07.891690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:07.901687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3ab67896-5dcc-42ec-b8af-a6256c740c1b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.384382 Aug 22 16:01:07.915520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 140/273] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:07 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:08.116677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:08.117900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:08.139661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:08.140567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:08.143306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:08.144459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:08.145164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:08.147516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:08.322377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-e7aad712-e191-493d-b4d8-75a874f6e45f req-2356c93b-5d24-4feb-ab1f-e9f2962cab22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2a6980-8937-485c-b773-bdd5eb754ca7", "tag": "4201889c-2b6f-405e-b57d-cdd19294861e"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:08.357976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e7aad712-e191-493d-b4d8-75a874f6e45f req-2356c93b-5d24-4feb-ab1f-e9f2962cab22 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:08.360518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e7aad712-e191-493d-b4d8-75a874f6e45f req-2356c93b-5d24-4feb-ab1f-e9f2962cab22 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:08.364347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e7aad712-e191-493d-b4d8-75a874f6e45f req-2356c93b-5d24-4feb-ab1f-e9f2962cab22 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:08.396515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:08.400856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-e7aad712-e191-493d-b4d8-75a874f6e45f req-2356c93b-5d24-4feb-ab1f-e9f2962cab22 service nova] Creating event network-changed:4201889c-2b6f-405e-b57d-cdd19294861e for instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 on hv-cinder-85400 Aug 22 16:01:08.424951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-e7aad712-e191-493d-b4d8-75a874f6e45f req-2356c93b-5d24-4feb-ab1f-e9f2962cab22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111694 Aug 22 16:01:08.425665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 141/274] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:08.556695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:08.565858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a177d7be-e5ea-4262-b5d4-5a28f1ad8487 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1361 microversion: 2.1 time: 0.453480 Aug 22 16:01:08.581066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 134/275] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:08 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1361 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:08.926857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:08.928149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:08.951117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:08.955765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:08.956619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:08.957527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:08.958370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:08.958978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:09.161244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:09.173844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af76994d-5bae-44c4-b87e-c065476705ba tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.248302 Aug 22 16:01:09.176690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 142/276] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:08 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:09.590598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:09.591247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:09.604313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:09.604753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:09.605198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:09.605919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:09.606378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:09.606807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:09.871198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:09.882012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cd3e4eff-6331-4902-be6b-4db927d8bf6e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1361 microversion: 2.1 time: 0.295273 Aug 22 16:01:09.882853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 135/277] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:09 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:10.197616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:10.198295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:10.205378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:10.205861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:10.206494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:10.207401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:10.208467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:10.209059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:10.454357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5370eafc-520d-4f5c-a33d-62afc31a7c42 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Action: 'create', calling method: .version_select at 0x7fec9c3e9a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-579268431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL63qJYDmlb7tozNCg+B5jhrdGOwa3XJbfaSQgH4s3QZCMMO65dC6XzzuOWY45R1qv+lxGcYp/SxXEAqnAOyE1uZ3vHIeBeDuvVvgsEX+ZnewJFEUaohNI8NMHRay33OKw=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:10.472447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-5370eafc-520d-4f5c-a33d-62afc31a7c42 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Getting quotas for project cb5f34dcc6dd4d6c9f52af4cc142bb13. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:01:10.477623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-5370eafc-520d-4f5c-a33d-62afc31a7c42 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Getting quotas for user f50207197b8b46cea2ea40ca346bd8a0 and project cb5f34dcc6dd4d6c9f52af4cc142bb13. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:01:10.486471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:10.495641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3399f94b-c4ed-4470-8218-de65d59d41e7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.302140 Aug 22 16:01:10.519500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 143/278] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:10 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:10.522454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5370eafc-520d-4f5c-a33d-62afc31a7c42 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.295976 Aug 22 16:01:10.529976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:10.530478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:10.531543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 136/279] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:01:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:01:10.539374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:10.540629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:10.542132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:10.543762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:10.544440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:10.545315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:10.577983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b9b13880-229f-443d-b02f-e3fd5e8026ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/ips" status: 200 len: 153 microversion: 2.20 time: 0.056271 Aug 22 16:01:10.578297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 144/280] 10.222.0.40 () {60 vars in 1289 bytes} [Mon Aug 22 16:01:10 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/ips => generated 153 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 16:01:10.908353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:10.908981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:10.918743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:10.919243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:10.919867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:10.920820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:10.921734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:10.922752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:11.115642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:11.126888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b5110f90-9b39-4f07-b906-ebfbea177d17 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1361 microversion: 2.1 time: 0.223786 Aug 22 16:01:11.127753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 137/281] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:10 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:11.519144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:11.520604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:11.527498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:11.529146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=10 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:11.531670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:11.532227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:11.533048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:11.534119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:11.535450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:11.536392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:11.734027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:11.747002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-38eebdd2-4a1e-46a5-839e-12961617c152 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.232400 Aug 22 16:01:11.749050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 145/282] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:11 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:12.171684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:12.173017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:12.189789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:12.189789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:12.190375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:12.191315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:12.191749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:12.192367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:12.419098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:12.451912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8819f499-c5ab-47b8-9ac5-cca579733326 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1361 microversion: 2.1 time: 0.304223 Aug 22 16:01:12.453212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 138/283] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:12 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:12.779475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:12.782173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:12.798897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:12.800234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:12.802092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:12.804838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:12.806019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:12.806665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:13.033422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:13.045935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a1bbe88a-9e33-462d-9e15-3b978611abbd tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.269567 Aug 22 16:01:13.050457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 146/284] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:12 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:13.101717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:13.106545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:13.129121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:13.131234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:13.133511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:13.137262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:13.139010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:13.139511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:13.174144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lazy-loading 'flavor' on Instance uuid 31a6012e-3710-4ea5-9cfa-7e0e34321caf {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:01:13.472996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:13.473520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:13.480401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:13.481407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:13.482224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:13.483604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:13.484312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:13.484822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:13.702132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:13.712519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6d879b77-fa08-4d06-8676-9c3b3f160ee1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1361 microversion: 2.1 time: 0.243369 Aug 22 16:01:13.713715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 147/285] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:13 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:14.075369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:14.075369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:14.087527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:14.088119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:14.088681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:14.089587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:14.090050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:14.092424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:14.301119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:14.310470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16bb1166-be0c-4000-bdf7-706df710601f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.243611 Aug 22 16:01:14.311919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 148/286] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:14 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:14.317482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7d80f4b8-98cb-4be3-9bd8-68f2dc5a341f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: .version_select at 0x7fec9c2ab820>, body: {"keypair": {"name": "tempest-keypair-217255009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs7vVLB21RN6cPKjPsfYZYDVAVB99tdPz0NSMc4+WT5vbqtEnwc1dzIz1M83ahCGU77KsttIfVk672YZEnIhIKKGvGwRTD4KPLzYKzIa9AZGJlysrdYKH0WwdbQSXBO6w=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:14.340773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-7d80f4b8-98cb-4be3-9bd8-68f2dc5a341f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:01:14.346576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-7d80f4b8-98cb-4be3-9bd8-68f2dc5a341f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for user 1b896f9378dc4188868734e05ddd39fb and project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:01:14.389207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7d80f4b8-98cb-4be3-9bd8-68f2dc5a341f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074828 Aug 22 16:01:14.395944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 149/287] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:01:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:14.403579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-538da103-4be0-4be3-b9f5-676f78f45e91 req-46ea5971-42aa-4dab-898b-b60da4a395b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2a6980-8937-485c-b773-bdd5eb754ca7", "name": "network-vif-plugged", "status": "completed", "tag": "4201889c-2b6f-405e-b57d-cdd19294861e"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:14.428045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-538da103-4be0-4be3-b9f5-676f78f45e91 req-46ea5971-42aa-4dab-898b-b60da4a395b6 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:14.429368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-538da103-4be0-4be3-b9f5-676f78f45e91 req-46ea5971-42aa-4dab-898b-b60da4a395b6 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:14.430528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-538da103-4be0-4be3-b9f5-676f78f45e91 req-46ea5971-42aa-4dab-898b-b60da4a395b6 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:14.453994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-538da103-4be0-4be3-b9f5-676f78f45e91 req-46ea5971-42aa-4dab-898b-b60da4a395b6 service nova] Creating event network-vif-plugged:4201889c-2b6f-405e-b57d-cdd19294861e for instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 on hv-cinder-85400 Aug 22 16:01:14.461135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-538da103-4be0-4be3-b9f5-676f78f45e91 req-46ea5971-42aa-4dab-898b-b60da4a395b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067589 Aug 22 16:01:14.462785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 150/288] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:14.736453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:14.737594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:14.748181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:14.748762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:14.749196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:14.750072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:14.750532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:14.750955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:15.026908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:15.039413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9b0e7c1a-e293-4bfa-820c-7cff909e3e83 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1361 microversion: 2.1 time: 0.308861 Aug 22 16:01:15.051223 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 151/289] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:14 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:15.332843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:15.334046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:15.344309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:15.345374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:15.345920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:15.346910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:15.347645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:15.348167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:15.650279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:15.660506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8ef705c5-dc42-4a64-8ecd-addbc5d1826e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1500 microversion: 2.1 time: 0.332639 Aug 22 16:01:15.661388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 152/290] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:15 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1500 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:15.688139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0159fb14-ed51-42ff-b72b-398167de5c95"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:15.691085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:15.704740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:15.706493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:15.707459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:15.709098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:15.710723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:15.711507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:15.745674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] HTTP exception thrown: Cannot 'attach_volume' instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 while it is in vm_state rescued Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Request method failure captured: Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5/os-volume_attachments HTTP/1.1 Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 74 Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fNthFCijBQYcUNtTBQSuBJ0oD9BJrnH3cIsim9NghrABLAj84RpI4-D9mE0jOusXI4P77OcTvIQq1TvMD_MA-JWKQnsgAHYUlVNj9F3B-vq-qKyZBS7BDg_WFHGVOGxLxfqMb5RAJ7mtPqIlONGfnCgnHBrSMipnDj0OwD8lwkro8 Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:01:15.747588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf2968f38ecf4e1aaf22dad09767c744", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}] Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 79dc62d7bb984157a117f79001a2ad68 Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {"volumeAttachment": {"volumeId": "0159fb14-ed51-42ff-b72b-398167de5c95"}} Aug 22 16:01:15.749576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Cannot 'attach_volume' instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 while it is in vm_state rescued Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '91e589fa-e174-4b10-a78f-dd18b10b90f5', 'body': {'volumeAttachment': {'volumeId': '0159fb14-ed51-42ff-b72b-398167de5c95'}}} Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:01:15.750599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 while it is in vm_state rescued Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:01:15.752564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:01:15.754163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:01:15.754163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:01:15.754163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 while it is in vm_state rescued Aug 22 16:01:15.754163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:01:15.754163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Returning 409 to user: Cannot 'attach_volume' instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 while it is in vm_state rescued {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:01:15.754163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2fd64aee-7a41-4bd3-bc53-0b7be246416f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073834 Aug 22 16:01:15.755928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 153/291] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:01:15 2022] POST /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 22 16:01:15.767960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:15.767960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:15.776579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:15.777458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:15.778157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:15.780025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:15.780719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:15.781517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:15.882770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cb4646b2-ade8-4fd9-b3b4-20e05bc4df57 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5/action" status: 202 len: 0 microversion: 2.1 time: 0.122568 Aug 22 16:01:15.883494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 154/292] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:01:15 2022] POST /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:01:15.894009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:15.894797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:15.901165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:15.901695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:15.902164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:15.902897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:15.903545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:15.903981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:16.357524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:16.367120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0dfa35f0-4b5c-4736-a25a-46e8b9b5f7c4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1508 microversion: 2.1 time: 0.478571 Aug 22 16:01:16.367918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 155/293] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:15 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1508 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:16.375881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:16.376699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:16.384490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:16.385013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:16.385467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:16.386172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:16.386635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:16.387061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:16.624559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:16.633114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-be35c2f3-cdc1-49ca-ad18-da3caf4e1049 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1361 microversion: 2.1 time: 0.263933 Aug 22 16:01:16.633958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 156/294] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:16 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:16.667849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1411759897", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b541efda-15ea-4562-82cd-397beeb78e3b"}], "security_groups": [{"name": "tempest-securitygroup--2067095790"}], "key_name": "tempest-keypair-217255009", "user_data": "}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:20.486325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:23.128969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:23.317213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:24.365220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:24.936767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7d027f8a-be83-4533-ad39-adebcd954a32 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/action" status: 202 len: 0 microversion: 2.20 time: 11.845371 Aug 22 16:01:24.937363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 139/295] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Aug 22 16:01:13 2022] POST /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/action => generated 0 bytes in 11853 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:01:24.943267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:24.943987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:24.950520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:24.951045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:24.951509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:24.952354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:24.953073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:24.953571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:24.991606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] validate_networks() for [('b541efda-15ea-4562-82cd-397beeb78e3b', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:01:25.182433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:25.190787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-88d4d6ad-303a-425d-a6de-ecbe39d0baa7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1514 microversion: 2.1 time: 0.252290 Aug 22 16:01:25.191424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 140/296] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:24 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:25.195955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:25.196790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:25.203685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:25.204183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:25.204624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:25.205338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:25.205796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:25.206228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:25.439255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:25.449227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8d167be-ab6e-4c29-84ec-d9195796683f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1548 microversion: 2.1 time: 0.256622 Aug 22 16:01:25.450564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 141/297] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:25 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1548 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:25.456193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:25.456963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:25.463289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:25.463804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:25.464244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:25.464939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:25.465571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:25.466024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:25.643463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:01:25.644016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:01:25.644348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:01:25.644755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:01:25.645158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:01:25.654534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:25.655011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:25.655483 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:25.656213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:25.656667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:25.657089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:25.673364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:25.676248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:01:25.680766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for user 1b896f9378dc4188868734e05ddd39fb and project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:01:25.681562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:25.683065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:25.684248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7378e51f-28bb-476d-ae75-046a22a45765 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.231919 Aug 22 16:01:25.684855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 142/298] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:25 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:25.689888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:25.690440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:25.696147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:25.696627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:25.697059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:25.697429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:01:25.697748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:25.698202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:25.698630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:25.700094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:01:25.750420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a350ce58-6397-4dd3-b315-336cf5a5a866 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 9.086813 Aug 22 16:01:25.751241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 157/299] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:01:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 9088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 16:01:25.761992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-757d08a9-19d9-4ee8-8dad-bbf19ffc420f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:25.762621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-757d08a9-19d9-4ee8-8dad-bbf19ffc420f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:25.784375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-22028b18-7318-438e-ab7d-8fa1a4418f4d tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097950 Aug 22 16:01:25.784966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 143/300] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 22 16:01:25 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:25.817333 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-757d08a9-19d9-4ee8-8dad-bbf19ffc420f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:25.826334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-757d08a9-19d9-4ee8-8dad-bbf19ffc420f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1241 microversion: 2.1 time: 0.067688 Aug 22 16:01:25.827472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 158/301] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:25 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:26.626085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a9f79fcf-1d65-4925-b7d7-443aeae35149 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'create', calling method: .version_select at 0x7fec9c3fc160>, body: {"keypair": {"name": "tempest-keypair-56630103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIxZcQMhogCaNHdna2wwXjwvzzO8Mabp28Qr6fmsbirj8EOc+EU+1c+ZtumyvmUfJpm74Lt6xeVDMYhkqIW+9wP02XXJbh8NKdnROO6s842kwaSwZxz24M2zOYh0pbMpg=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:26.642740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-a9f79fcf-1d65-4925-b7d7-443aeae35149 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Getting quotas for project cf2968f38ecf4e1aaf22dad09767c744. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:01:26.646632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-a9f79fcf-1d65-4925-b7d7-443aeae35149 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Getting quotas for user 79dc62d7bb984157a117f79001a2ad68 and project cf2968f38ecf4e1aaf22dad09767c744. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:01:26.671497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a9f79fcf-1d65-4925-b7d7-443aeae35149 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050329 Aug 22 16:01:26.672108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 144/302] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:01:26 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:26.709541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:26.710363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:26.719433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:26.720070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:26.720722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:26.721685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:26.722239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:26.722843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:26.849612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:26.850480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:26.857363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:26.857957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:26.858489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:26.859373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:26.860086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:26.860525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:26.894643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:26.907605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:26.910467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:26.917479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-96d4991f-e8d6-445e-b75c-fc825487c3dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.212324 Aug 22 16:01:26.919518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 159/303] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:26 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:01:26.982503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:26.994219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e28a916c-2d0e-4c78-af29-3b2f090a9ab3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1293 microversion: 2.1 time: 0.148560 Aug 22 16:01:26.995260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 145/304] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:26 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:27.045495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-bbb0a6ef-170f-4582-898c-90cbf52320e9 req-0d768e5d-92f0-4ddb-8b83-e2af7020bc39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2a6980-8937-485c-b773-bdd5eb754ca7", "tag": "4201889c-2b6f-405e-b57d-cdd19294861e"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:27.057178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-bbb0a6ef-170f-4582-898c-90cbf52320e9 req-0d768e5d-92f0-4ddb-8b83-e2af7020bc39 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:27.057664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-bbb0a6ef-170f-4582-898c-90cbf52320e9 req-0d768e5d-92f0-4ddb-8b83-e2af7020bc39 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:27.058094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-bbb0a6ef-170f-4582-898c-90cbf52320e9 req-0d768e5d-92f0-4ddb-8b83-e2af7020bc39 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:27.076895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-bbb0a6ef-170f-4582-898c-90cbf52320e9 req-0d768e5d-92f0-4ddb-8b83-e2af7020bc39 service nova] Creating event network-changed:4201889c-2b6f-405e-b57d-cdd19294861e for instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 on hv-cinder-85400 Aug 22 16:01:27.083687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-bbb0a6ef-170f-4582-898c-90cbf52320e9 req-0d768e5d-92f0-4ddb-8b83-e2af7020bc39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045312 Aug 22 16:01:27.088692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 160/305] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:27.944222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:27.945609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:27.954703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:27.955786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:27.956509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:27.958412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:27.959457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:27.960215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:28.031395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:28.032263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:28.049887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:28.050682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:28.051393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:28.052232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:28.052824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:28.053495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:28.186183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:28.197083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af00e4dd-afc5-47b3-a2b8-00f67fb2bdc8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1299 microversion: 2.1 time: 0.181746 Aug 22 16:01:28.213718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 161/306] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:28 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:28.268825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:28.278548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:28.281130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:28.282524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9b9afb90-14a1-4e32-8161-991456cd1bec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.343749 Aug 22 16:01:28.283663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 146/307] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:27 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:28.777098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1298102178", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14653ea1-7c5c-49e7-aba7-9205a366cf57"}], "security_groups": [{"name": "tempest-securitygroup--1071699126"}], "key_name": "tempest-keypair-56630103", "user_data": "}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:28.939569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] validate_networks() for [('14653ea1-7c5c-49e7-aba7-9205a366cf57', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:01:29.223921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:29.225164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:29.231317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:29.231843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:29.232280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:29.232984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:29.233440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:29.233867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:29.564526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:29.572438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-935e4176-b9d5-4960-a831-cb971a669a24 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.353054 Aug 22 16:01:29.573104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 147/308] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:29 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:29.577825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:29.578530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:29.584750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:29.585353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:29.585855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:29.586569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:29.587018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:29.587669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:29.971584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:01:29.972636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:01:29.973239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:01:29.973711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:01:29.974142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:01:29.984410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:29.984955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:29.985393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:29.986214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:29.986718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:29.987139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:29.994113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:30.008243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Getting quotas for project cf2968f38ecf4e1aaf22dad09767c744. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:01:30.012168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Getting quotas for user 79dc62d7bb984157a117f79001a2ad68 and project cf2968f38ecf4e1aaf22dad09767c744. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:01:30.024308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:01:30.026615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:01:30.035236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:30.044115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:30.045738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:30.046996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8b1d1387-1664-46e3-bdc4-01dcf78bf1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.472890 Aug 22 16:01:30.047709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 148/309] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:29 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:30.069267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-4f659a73-484d-4817-a1e7-7c2645bb25b5 req-32f92bf0-af60-4301-8e28-a85afb1aaa5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b535aef-666c-4f54-896d-e94dc94dee48", "tag": "1d848c57-654a-40af-89f7-77830671bb9c"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:30.078368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-802be3da-f649-4091-9e27-8474bf727362 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.305604 Aug 22 16:01:30.079510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 162/310] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:01:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 16:01:30.086285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-4f659a73-484d-4817-a1e7-7c2645bb25b5 req-32f92bf0-af60-4301-8e28-a85afb1aaa5e service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:30.087492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-4f659a73-484d-4817-a1e7-7c2645bb25b5 req-32f92bf0-af60-4301-8e28-a85afb1aaa5e service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:30.087939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-4f659a73-484d-4817-a1e7-7c2645bb25b5 req-32f92bf0-af60-4301-8e28-a85afb1aaa5e service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:30.093820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8bc3ed10-4b80-4492-97d4-3f15e5542628 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:30.094638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8bc3ed10-4b80-4492-97d4-3f15e5542628 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:30.101558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-4f659a73-484d-4817-a1e7-7c2645bb25b5 req-32f92bf0-af60-4301-8e28-a85afb1aaa5e service nova] Creating event network-changed:1d848c57-654a-40af-89f7-77830671bb9c for instance 8b535aef-666c-4f54-896d-e94dc94dee48 on hv-cinder-85400 Aug 22 16:01:30.108487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-4f659a73-484d-4817-a1e7-7c2645bb25b5 req-32f92bf0-af60-4301-8e28-a85afb1aaa5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049391 Aug 22 16:01:30.109886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 149/311] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:30.168048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8bc3ed10-4b80-4492-97d4-3f15e5542628 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:30.176668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8bc3ed10-4b80-4492-97d4-3f15e5542628 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1244 microversion: 2.1 time: 0.090380 Aug 22 16:01:30.177246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 163/312] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:30 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:30.596047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:30.596937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:30.603361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:30.603812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:30.604352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:30.605094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:30.605556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:30.605983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:30.738164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:30.745667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-234d617c-d2dd-46e2-932c-008b02a535cf tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.155743 Aug 22 16:01:30.746226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 150/313] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:30 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:31.073517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:31.074125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:31.076425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:31.081670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:31.082159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:31.082867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:31.083590 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:31.084050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:31.084476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:31.197700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:31.198365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:31.204294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:31.204776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:31.205210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:31.205902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:31.206419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:31.206843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:31.217978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:31.226984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:31.228534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:31.229723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0f2ed2e0-5948-481a-b684-d34033f2a0f2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.160198 Aug 22 16:01:31.230297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 164/314] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:31 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:31.269484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:31.277020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ae29b34c-36af-430f-920e-54d7f05334d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1248 microversion: 2.1 time: 0.083243 Aug 22 16:01:31.277585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 151/315] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:31 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:31.767282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:31.767944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:31.774008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:31.774866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:31.775496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:31.776377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:31.776636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:31.777052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:31.981120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:31.989826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c5a3e119-710a-4266-81e0-dbd7b1044b5a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.226392 Aug 22 16:01:31.990396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 165/316] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:31 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:32.253386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:32.254019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:32.260533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:32.261007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:32.261530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:32.262229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:32.262677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:32.263181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:32.301151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:32.301866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:32.310598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:32.311212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:32.311870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:32.312819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:32.313582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:32.314518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:32.420883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:32.434147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ba4eb906-5440-49df-91c2-823061c9f30d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1296 microversion: 2.1 time: 0.138216 Aug 22 16:01:32.439735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 166/317] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:32 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1296 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:32.642178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:32.652505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:32.654314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:32.656128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d5f29d07-6d1f-45e5-8306-59db543e74a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.406637 Aug 22 16:01:32.656960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 152/318] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:32 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:33.010700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:33.011315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:33.018222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:33.018715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:33.019534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:33.020354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:33.021187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:33.021918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:33.206165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:33.239369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6bcf4303-9b85-4473-9bce-985903cf893e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.231967 Aug 22 16:01:33.267945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 167/319] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:33 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:33.455120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:33.455973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:33.462191 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:33.462743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:33.463239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:33.464013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:33.464524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:33.465150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:33.614673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:33.623255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cdc3be9d-309d-4521-8928-1682171fbf7e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.171807 Aug 22 16:01:33.623905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 153/320] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:33 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:33.681782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:33.685502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:33.691444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:33.692033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:33.692582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:33.693406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:33.693943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:33.694462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:33.831803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:33.840615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:33.842199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:33.843479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-347dd326-a3ed-4136-be4f-5badb4521889 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.167208 Aug 22 16:01:33.844087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 168/321] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:33 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:33.861644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-67122703-ec3f-4ae6-8bca-25a964410ea7 req-d319d019-ddc2-4240-bea9-9a2ac69e4ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9341c753-156a-4cf4-82d1-be8cbb188892", "tag": "6251192b-4e4d-483e-bd56-34edb2edfa1c"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:33.873793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-67122703-ec3f-4ae6-8bca-25a964410ea7 req-d319d019-ddc2-4240-bea9-9a2ac69e4ff7 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:33.874285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-67122703-ec3f-4ae6-8bca-25a964410ea7 req-d319d019-ddc2-4240-bea9-9a2ac69e4ff7 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:33.874988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-67122703-ec3f-4ae6-8bca-25a964410ea7 req-d319d019-ddc2-4240-bea9-9a2ac69e4ff7 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:33.889701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-67122703-ec3f-4ae6-8bca-25a964410ea7 req-d319d019-ddc2-4240-bea9-9a2ac69e4ff7 service nova] Creating event network-changed:6251192b-4e4d-483e-bd56-34edb2edfa1c for instance 9341c753-156a-4cf4-82d1-be8cbb188892 on hv-cinder-85400 Aug 22 16:01:33.895760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-67122703-ec3f-4ae6-8bca-25a964410ea7 req-d319d019-ddc2-4240-bea9-9a2ac69e4ff7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037787 Aug 22 16:01:33.896344 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 154/322] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:01:34.275696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:34.276392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:34.282468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:34.283276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:34.283999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:34.284877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:34.285484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:34.286050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:34.437741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:34.446645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f2ae42b9-d54d-43cb-a013-05a380e01ec0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.174622 Aug 22 16:01:34.447211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 169/323] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:34 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:34.645532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:34.646154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:34.652380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:34.652853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:34.653284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:34.653978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:34.654428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:34.654849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:34.784834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:34.793670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a5c0b2fb-583f-4f9e-bb0f-47b89ff6d184 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.152381 Aug 22 16:01:34.794959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 155/324] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:34 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:34.866670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:34.867413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:34.874526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:34.875089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:34.875577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:34.876338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:34.876794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:34.877222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:35.012406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:35.020779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:35.022283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:35.023548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2717c904-facf-4dcd-9d34-3755568f8892 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.160728 Aug 22 16:01:35.024000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 170/325] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:34 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:35.469654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:35.470254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:35.476197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:35.476672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:35.477098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:35.477776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:35.478219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:35.478634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:35.608681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:35.616421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-374e3554-c424-4421-9189-73d57cf508b7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.151260 Aug 22 16:01:35.616982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 156/326] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:35 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:35.814827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:35.815473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:35.821544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:35.822027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:35.822463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:35.823659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:35.823659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:35.824064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:35.954768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:35.962868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-506515f0-01a7-42e2-a9ff-1e9ea4dd4429 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.151872 Aug 22 16:01:35.963450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 171/327] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:35 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:36.047612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:36.048232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:36.054603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:36.055195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:36.055558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:36.056263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:36.056720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:36.057148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:36.186888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:36.195160 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:36.196693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:36.197867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cda7055c-f572-4045-8e6b-ba9ff00ec40d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.154215 Aug 22 16:01:36.198411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 157/328] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:36 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:01:36.637569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:36.638180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:36.644308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:36.644787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:36.645257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:36.645942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:36.646395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:36.646816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:36.774800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:36.783070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6940099b-b965-4b11-a966-5cdfa857b353 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.149310 Aug 22 16:01:36.783672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 172/329] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:36 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:36.983878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:36.984488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:36.986464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:36.991621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:36.992104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:36.992543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:36.993237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:36.993696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:36.994122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:37.127153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:37.134912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8714816e-93f0-46d2-b4a8-925aec9a8cd5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.155432 Aug 22 16:01:37.135514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 158/330] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:36 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:37.222266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:37.222878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:37.229360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:37.229843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:37.230282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:37.230976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:37.231456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:37.231887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:37.369794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:37.378684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:37.380208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:37.381367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e4609745-9c48-4227-a286-944adde370df tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.163054 Aug 22 16:01:37.381915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 173/331] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:37 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:01:37.804427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:37.805046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:37.811362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:37.811970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:37.812590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:37.813464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:37.813924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:37.814351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:37.818872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:37.946850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:37.954512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-32725a69-89f6-40e5-a68b-60e48e2a7128 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.154152 Aug 22 16:01:37.955046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 159/332] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:37 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:38.157183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:38.157711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:38.164626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:38.165120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:38.165728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:38.166507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:38.167096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:38.167589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:38.297191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:38.305449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-91268263-a394-45b6-93b3-4003fccc0e73 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.152887 Aug 22 16:01:38.306013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 174/333] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:38 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:38.404685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:38.405291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:38.411322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:38.411774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:38.412213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:38.412901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:38.413373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:38.413799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:38.552602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:38.561366 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:38.562864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:38.564054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c2294c3e-3dfc-4055-9997-435f9e5cda19 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.163341 Aug 22 16:01:38.564603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 160/334] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:38 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:38.975654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:38.976272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:38.982950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:38.983468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:38.983909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:38.984608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:38.985064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:38.985492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:39.038483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-d2c3a9a3-d03a-4baa-b72b-1f7d906866e3 req-b0d0e920-75bd-4c60-ab75-bb9956f9748a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b535aef-666c-4f54-896d-e94dc94dee48", "name": "network-vif-plugged", "status": "completed", "tag": "1d848c57-654a-40af-89f7-77830671bb9c"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:39.049501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d2c3a9a3-d03a-4baa-b72b-1f7d906866e3 req-b0d0e920-75bd-4c60-ab75-bb9956f9748a service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:39.049915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d2c3a9a3-d03a-4baa-b72b-1f7d906866e3 req-b0d0e920-75bd-4c60-ab75-bb9956f9748a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:39.050670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d2c3a9a3-d03a-4baa-b72b-1f7d906866e3 req-b0d0e920-75bd-4c60-ab75-bb9956f9748a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:39.066467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-d2c3a9a3-d03a-4baa-b72b-1f7d906866e3 req-b0d0e920-75bd-4c60-ab75-bb9956f9748a service nova] Creating event network-vif-plugged:1d848c57-654a-40af-89f7-77830671bb9c for instance 8b535aef-666c-4f54-896d-e94dc94dee48 on hv-cinder-85400 Aug 22 16:01:39.072300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-d2c3a9a3-d03a-4baa-b72b-1f7d906866e3 req-b0d0e920-75bd-4c60-ab75-bb9956f9748a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037585 Aug 22 16:01:39.073213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 161/335] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:01:39.128701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:39.136661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c82c304b-1293-4a98-9fa0-4ba0bcdcfd18 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.164926 Aug 22 16:01:39.137264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 175/336] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:38 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:39.327004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:39.328018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:39.336561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:39.337051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:39.337486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:39.338363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:39.338857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:39.339552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:39.365212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-310787512", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-579268431", "security_groups": [{"name": "tempest-secgroup-smoke-1751899005"}], "block_device_mapping_v2": [{"uuid": "a88ccabb-8c45-4739-af09-e1ed59ab67d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c654763e-5b64-4bcf-9232-fa5fc5f9ad5d"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:39.559987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:39.563697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] validate_networks() for [('c654763e-5b64-4bcf-9232-fa5fc5f9ad5d', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:01:39.569332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-926297a6-fc3d-478f-bccf-fe5acd4a2bca tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.247222 Aug 22 16:01:39.571688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 162/337] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:39 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:39.591737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:39.592394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:39.600035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:39.600624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:39.601133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:39.601918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:39.602616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:39.603432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:39.846983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:39.856004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:39.858166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:39.859875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eccc6842-758d-406e-888b-0ac2d3f0a405 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1745 microversion: 2.20 time: 0.273014 Aug 22 16:01:39.860439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 163/338] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:39 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1745 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:39.994280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:40.063843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:01:40.064271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:01:40.064752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:01:40.065202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:01:40.065603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:01:40.074206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:40.074688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:40.075661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:40.076395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:40.076853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:40.077281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:40.094581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Getting quotas for project cb5f34dcc6dd4d6c9f52af4cc142bb13. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:01:40.098917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Getting quotas for user f50207197b8b46cea2ea40ca346bd8a0 and project cb5f34dcc6dd4d6c9f52af4cc142bb13. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:01:40.159421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:40.160705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:40.166605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:01:40.168133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:40.168762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:40.168988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a88ccabb-8c45-4739-af09-e1ed59ab67d8',volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:01:40.169392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:40.170251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:40.170842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:40.171375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:40.311758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-12ea3dc9-61b8-4abf-a5cb-259e7ce08e45 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.950210 Aug 22 16:01:40.312747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 176/339] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:01:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 16:01:40.323951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4d0c9b66-8a7c-44ed-b715-e9fd3cbcefab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:40.324654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4d0c9b66-8a7c-44ed-b715-e9fd3cbcefab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:40.343950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:40.353109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a122274f-8c72-4339-a146-e775c24fc7b1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.197692 Aug 22 16:01:40.353832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 164/340] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:40 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:40.384986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d0c9b66-8a7c-44ed-b715-e9fd3cbcefab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:40.392500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4d0c9b66-8a7c-44ed-b715-e9fd3cbcefab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1093 microversion: 2.1 time: 0.072824 Aug 22 16:01:40.393065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 177/341] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:40 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:40.592878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:40.594311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:40.601098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:40.601591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:40.602116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:40.602741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:40.603429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:40.603825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:40.754793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:40.762744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ef7e897e-71a5-4d33-8e26-99674fdb5010 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.174175 Aug 22 16:01:40.763304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 165/342] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:40 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:40.882588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:40.883281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:40.890236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:40.890718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:40.891152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:40.891873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:40.892323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:40.892742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:41.033479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:41.042338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:41.045349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:41.046559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-13f31e00-e80e-4aed-9ade-d456314c59cb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1745 microversion: 2.20 time: 0.167863 Aug 22 16:01:41.047139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 178/343] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:40 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:41.375540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:41.376089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:41.382263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:41.383359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:41.383830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:41.384571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:41.385030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:41.385463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:41.413462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:41.414224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:41.421706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:41.422217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:41.422665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:41.423377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:41.424045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:41.424664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:41.507231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:41.516120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c57ea4e1-98f7-4c53-b171-6322d9476424 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1191 microversion: 2.1 time: 0.106822 Aug 22 16:01:41.516800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 179/344] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:41 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:41.548260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:41.556234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b9fdf56a-da76-4029-b43b-cc610c9ad6dd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1367 microversion: 2.1 time: 0.185723 Aug 22 16:01:41.556779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 166/345] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:41 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:41.783602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:41.784127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:41.790214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:41.790694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:41.791130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:41.791843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:41.792299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:41.792726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:41.923554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:41.931384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-39a27da5-c347-4512-9e33-64a4da8e3698 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.151740 Aug 22 16:01:41.931961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 180/346] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:41 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:42.069765 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:42.070512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:42.078879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.079401 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.079848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.080594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.081052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.081482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.214177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:42.224294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:42.225810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:42.227967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-050a6a45-ee86-4bfe-bf74-1ce082fa9c24 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1745 microversion: 2.20 time: 0.161208 Aug 22 16:01:42.227967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 167/347] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:42 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:42.543422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:42.544055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:42.550503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.550989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.551455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.552150 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.552608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.553034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.579384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:42.580100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:42.587437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.587928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.588394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.589129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.589590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.590019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.622953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:42.633434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9e566261-16ba-439a-9a07-4b6bf4fa8674 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1199 microversion: 2.1 time: 0.099709 Aug 22 16:01:42.650022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 181/348] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:42 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1199 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:42.740165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:42.750850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9d06ace0-9a40-4bf4-90d9-0264917b591a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1557 microversion: 2.1 time: 0.177001 Aug 22 16:01:42.751440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 168/349] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:42 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:42.772092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:42.772689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:42.779366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.780010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.780443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.781144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.781596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.782011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.786223 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:42.860972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-51daae0f-c35a-4303-a01f-016093cb9bd3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092647 Aug 22 16:01:42.861577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 182/350] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 22 16:01:42 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:42.952419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:42.953038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:42.959857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.960348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.960791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:42.962399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:42.962863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:42.963295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:43.250587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:43.251203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:43.263361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:43.264069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:43.264767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:43.265547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:43.266079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:43.266666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:43.300977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:43.308805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3ed68324-677c-4493-8c20-58baa33e4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.360208 Aug 22 16:01:43.310532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 169/351] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:42 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:43.658501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:43.659449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:43.674933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:43.675640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:43.676186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:43.677027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:43.678123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:43.678661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:44.058569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:44.067855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:44.074303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:44.078913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6baff903-f864-4028-a842-7fd7f1ebf86b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.832973 Aug 22 16:01:44.079967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 183/352] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:43 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:01:44.088123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-338e0747-99a9-4ecf-a9dd-03d9ed204e82 req-b20f16d6-420c-4b8b-9dc6-81dcf4e8d885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6012e-3710-4ea5-9cfa-7e0e34321caf", "name": "network-vif-plugged", "status": "completed", "tag": "f9c81dc7-a34c-438c-8a49-f74d23ef8f2f"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:44.109946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-338e0747-99a9-4ecf-a9dd-03d9ed204e82 req-b20f16d6-420c-4b8b-9dc6-81dcf4e8d885 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:44.110441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-338e0747-99a9-4ecf-a9dd-03d9ed204e82 req-b20f16d6-420c-4b8b-9dc6-81dcf4e8d885 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:44.110871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-338e0747-99a9-4ecf-a9dd-03d9ed204e82 req-b20f16d6-420c-4b8b-9dc6-81dcf4e8d885 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:44.136505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-338e0747-99a9-4ecf-a9dd-03d9ed204e82 req-b20f16d6-420c-4b8b-9dc6-81dcf4e8d885 service nova] Creating event network-vif-plugged:f9c81dc7-a34c-438c-8a49-f74d23ef8f2f for instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf on hv-cinder-85400 Aug 22 16:01:44.151091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-338e0747-99a9-4ecf-a9dd-03d9ed204e82 req-b20f16d6-420c-4b8b-9dc6-81dcf4e8d885 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069803 Aug 22 16:01:44.152084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 184/353] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:44.229384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:44.245129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-159aceaf-345b-40d7-a24a-31f1e6f472fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1277 microversion: 2.1 time: 0.591520 Aug 22 16:01:44.246304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 170/354] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:43 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1277 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:44.331522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:44.332234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:44.344360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:44.344897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:44.345344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:44.346139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:44.346542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:44.346977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:44.695123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:44.711624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b36fe234-0fc8-458f-9f4c-d878fbc945da tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.384026 Aug 22 16:01:44.713392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 185/355] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:44 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:44.768695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-ab0fa176-77f1-4b18-9bf0-8ac0755267f0 req-2a11b1ce-8963-4ccd-84b9-06942a1d482d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b", "tag": "1de14c98-3830-4ed5-8d8d-c98cefc71394"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:44.791706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-ab0fa176-77f1-4b18-9bf0-8ac0755267f0 req-2a11b1ce-8963-4ccd-84b9-06942a1d482d service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:44.792462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-ab0fa176-77f1-4b18-9bf0-8ac0755267f0 req-2a11b1ce-8963-4ccd-84b9-06942a1d482d service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:44.793756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-ab0fa176-77f1-4b18-9bf0-8ac0755267f0 req-2a11b1ce-8963-4ccd-84b9-06942a1d482d service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:44.818352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-ab0fa176-77f1-4b18-9bf0-8ac0755267f0 req-2a11b1ce-8963-4ccd-84b9-06942a1d482d service nova] Creating event network-changed:1de14c98-3830-4ed5-8d8d-c98cefc71394 for instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b on hv-cinder-85400 Aug 22 16:01:44.826033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-ab0fa176-77f1-4b18-9bf0-8ac0755267f0 req-2a11b1ce-8963-4ccd-84b9-06942a1d482d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061397 Aug 22 16:01:44.828213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 171/356] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:45.093519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-870fbc01-d7fe-45f2-bf24-8dd6f3870854 req-f4f6a3f4-00c1-43ad-b456-0014962be785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b535aef-666c-4f54-896d-e94dc94dee48", "tag": "1d848c57-654a-40af-89f7-77830671bb9c"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:45.107977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:45.108913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:45.118183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-870fbc01-d7fe-45f2-bf24-8dd6f3870854 req-f4f6a3f4-00c1-43ad-b456-0014962be785 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:45.119298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-870fbc01-d7fe-45f2-bf24-8dd6f3870854 req-f4f6a3f4-00c1-43ad-b456-0014962be785 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:45.120494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-870fbc01-d7fe-45f2-bf24-8dd6f3870854 req-f4f6a3f4-00c1-43ad-b456-0014962be785 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:45.120618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:45.122990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:45.123604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:45.125934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:45.126770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:45.127958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:45.135526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-870fbc01-d7fe-45f2-bf24-8dd6f3870854 req-f4f6a3f4-00c1-43ad-b456-0014962be785 service nova] Creating event network-changed:1d848c57-654a-40af-89f7-77830671bb9c for instance 8b535aef-666c-4f54-896d-e94dc94dee48 on hv-cinder-85400 Aug 22 16:01:45.141764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-870fbc01-d7fe-45f2-bf24-8dd6f3870854 req-f4f6a3f4-00c1-43ad-b456-0014962be785 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052071 Aug 22 16:01:45.146914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 186/357] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:45.282674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:45.283692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:45.296570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:45.301025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:45.301862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:45.305598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:45.306397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:45.307082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:45.549704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:45.564229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:45.571366 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:45.576354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-65818f10-4637-4fef-a217-090c20290577 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.473776 Aug 22 16:01:45.581142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 172/358] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:45 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:45.695875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:45.720441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-452b3b3e-d933-4fb0-a443-467b61e5f513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.443534 Aug 22 16:01:45.721578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 187/359] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:45 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:45.740828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:45.741696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:45.748899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:45.749662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:45.750267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:45.751155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:45.751788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:45.752376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:45.915733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:45.927006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e3549b23-757d-4605-8f8f-4819ca9bd850 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.189780 Aug 22 16:01:45.927998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 173/360] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:45 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:46.200452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-c5775bd8-a2e9-4fc7-ba26-3bbd31a4a81c req-2f86c6b9-9f7d-4f3a-8497-38af034e6ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9341c753-156a-4cf4-82d1-be8cbb188892", "name": "network-vif-plugged", "status": "completed", "tag": "6251192b-4e4d-483e-bd56-34edb2edfa1c"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:46.217158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c5775bd8-a2e9-4fc7-ba26-3bbd31a4a81c req-2f86c6b9-9f7d-4f3a-8497-38af034e6ee5 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:46.217802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c5775bd8-a2e9-4fc7-ba26-3bbd31a4a81c req-2f86c6b9-9f7d-4f3a-8497-38af034e6ee5 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:46.218339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c5775bd8-a2e9-4fc7-ba26-3bbd31a4a81c req-2f86c6b9-9f7d-4f3a-8497-38af034e6ee5 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:46.243071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-c5775bd8-a2e9-4fc7-ba26-3bbd31a4a81c req-2f86c6b9-9f7d-4f3a-8497-38af034e6ee5 service nova] Creating event network-vif-plugged:6251192b-4e4d-483e-bd56-34edb2edfa1c for instance 9341c753-156a-4cf4-82d1-be8cbb188892 on hv-cinder-85400 Aug 22 16:01:46.249009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-c5775bd8-a2e9-4fc7-ba26-3bbd31a4a81c req-2f86c6b9-9f7d-4f3a-8497-38af034e6ee5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054094 Aug 22 16:01:46.251877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 188/361] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:46.614214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:46.615730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:46.622457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:46.623196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:46.623840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:46.624722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:46.625340 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:46.626534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:46.747357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:46.748680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:46.768348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:46.770486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:46.770981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:46.771763 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:46.772235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:46.772671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:46.858068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:46.873597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:46.875425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:46.877441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d854c918-a845-4855-840b-80fd3d7dbbcd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.267832 Aug 22 16:01:46.891756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 174/362] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:46 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:46.949564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:46.950960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:46.960305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:46.962642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:46.963697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:46.964638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:46.965029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:46.965590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:47.011863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:47.020418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-367a0b34-24a2-4cec-87a8-e08d9c01c563 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.277860 Aug 22 16:01:47.021652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 189/363] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:46 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:47.135811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:47.146024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ec431808-1f05-433f-a3d8-754518526ac2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.201524 Aug 22 16:01:47.147041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 175/364] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:46 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:47.918523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:47.920379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:47.933236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:47.933769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:47.934811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:47.935603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:47.936057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:47.936477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:48.043374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:48.045372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:48.061784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:48.062655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:48.063305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:48.064282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:48.064949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:48.065607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:48.156774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:48.168864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:48.170900 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:48.172338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a66d73a2-d792-464b-b93a-84b9d12b4767 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.262037 Aug 22 16:01:48.191200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 190/365] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:47 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:48.200715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:48.202385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:48.219199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:48.220053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:48.220984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:48.221958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:48.222649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:48.223298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:48.292249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:48.301186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-03dac741-3ae9-4b84-a49c-73241dd9e9be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.261667 Aug 22 16:01:48.315845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 176/366] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:48 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:48.392360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:48.406926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eb47270b-997d-4034-86f8-67769bc33cd9 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1370 microversion: 2.1 time: 0.213196 Aug 22 16:01:48.408010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 191/367] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:48 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:49.195966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:49.197319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:49.204457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:49.204940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:49.205374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:49.206072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:49.206516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:49.206956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:49.211606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:49.322493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:49.323773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:49.331081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:49.331911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:49.332788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:49.333649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:49.334259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:49.337310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:49.351304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:49.365476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:49.367534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:49.369061 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-991fb749-3a11-4887-97c8-254d05a8aca3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.177011 Aug 22 16:01:49.369622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 177/368] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:49 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:49.429216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:49.433588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:49.441186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:49.442117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:49.443261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:49.444212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:49.444862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:49.445510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:49.541856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:49.551749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f64325c3-1623-4b99-b44d-5ac6fbe8770d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.232491 Aug 22 16:01:49.565960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 192/369] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:49 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:49.626972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:49.635831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dee6debb-db83-408d-8580-b0e3cfb36ddc tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1564 microversion: 2.1 time: 0.211706 Aug 22 16:01:49.636580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 178/370] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:49 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1564 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:49.657507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:49.658107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:49.664282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:49.664836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:49.665470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:49.666515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:49.667239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:49.667837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:49.754538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6060a3a5-db16-42ca-8f52-cbb63e019b7c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101210 Aug 22 16:01:49.755526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 193/371] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 22 16:01:49 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:01:50.396621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:50.397232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:50.405887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:50.406373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:50.406807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:50.407541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:50.408394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:50.408956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:50.600365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:50.602475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:50.610343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:50.611906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:50.613318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=24 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:50.622218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:50.623939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:50.625313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2bce4e18-8ad1-45cf-acf8-3cde912a3d4d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.232561 Aug 22 16:01:50.626511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 179/372] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:50 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:50.628725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:50.629408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:50.629996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:50.631612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:50.632212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:50.632770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:50.820663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:50.837276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3811a8c8-7f39-487c-a595-8095204c3a46 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.266166 Aug 22 16:01:50.838465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 194/373] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:50 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:50.948429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-21ce253d-4a5f-4b72-937c-437e24dc4007 req-81351140-f812-4685-810f-5303cd81384a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9341c753-156a-4cf4-82d1-be8cbb188892", "tag": "6251192b-4e4d-483e-bd56-34edb2edfa1c"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:01:50.961577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-21ce253d-4a5f-4b72-937c-437e24dc4007 req-81351140-f812-4685-810f-5303cd81384a service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:50.962158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-21ce253d-4a5f-4b72-937c-437e24dc4007 req-81351140-f812-4685-810f-5303cd81384a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:50.962597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-21ce253d-4a5f-4b72-937c-437e24dc4007 req-81351140-f812-4685-810f-5303cd81384a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:50.981839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-21ce253d-4a5f-4b72-937c-437e24dc4007 req-81351140-f812-4685-810f-5303cd81384a service nova] Creating event network-changed:6251192b-4e4d-483e-bd56-34edb2edfa1c for instance 9341c753-156a-4cf4-82d1-be8cbb188892 on hv-cinder-85400 Aug 22 16:01:50.987065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-21ce253d-4a5f-4b72-937c-437e24dc4007 req-81351140-f812-4685-810f-5303cd81384a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042239 Aug 22 16:01:50.988818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 180/374] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:01:51.654634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:51.655226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:51.665873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:51.666347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:51.667795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:51.669265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:51.669724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:51.670315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:51.841896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:51.850867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:51.853416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:51.854986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b61406e7-a513-44ab-bfd5-3034fd34e1d1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.204772 Aug 22 16:01:51.856312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 195/375] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:51 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:51.874018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:51.875313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:51.889225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:51.891093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:51.892517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:51.893437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:51.893928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:51.894324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:52.077298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:52.085680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ba2d8f98-35c4-4d4a-b048-a01b3403f3d6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.231153 Aug 22 16:01:52.086244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 181/376] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:51 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:01:52.878671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:52.879617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:52.886482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:52.887525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:52.887967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:52.888676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:52.889131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:52.889994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:53.067420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:53.076888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:53.078856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:53.080144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0c675cba-89a3-44d4-a517-11010f3b5af5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.205832 Aug 22 16:01:53.080717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 196/377] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:52 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:53.115099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:53.115743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:53.128944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:53.129359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:53.129800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:53.130519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:53.130973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:53.131425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:53.286708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:53.295976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d5242ea0-e1ef-4505-b5ff-c5b5f816985c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.193170 Aug 22 16:01:53.296552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 182/378] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:53 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:54.103591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:54.104217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:54.111552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:54.112362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:54.113055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:54.113992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:54.114719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:54.115427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:54.253946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:54.265310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:54.266878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:54.268115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f950f6bc-9d4a-4c2b-b8ee-63eae1bf5ebd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.168508 Aug 22 16:01:54.268693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 197/379] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:54 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:54.321076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:54.322125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:54.325721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:54.334614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:54.335201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:54.335814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:54.336643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:54.337244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:54.337770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:54.679173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:54.687293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-554ac649-f7f2-445c-abbd-9c5e1a991c74 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.372820 Aug 22 16:01:54.687876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 183/380] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:54 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:55.291709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:55.292253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:55.300173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:55.300660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:55.301094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:55.301784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:55.302238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:55.302662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:55.430151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:55.439095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:55.440641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:55.441883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-44acff9d-4344-4cbe-b967-8d023def1e9d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.154181 Aug 22 16:01:55.442451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 198/381] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:55 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:55.708627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:55.709141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:55.715667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:55.716147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:55.716582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:55.717277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:55.717732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:55.718158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:55.850560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:55.858721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4419e8f5-326e-42dc-b440-9d8cdc911e30 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.154299 Aug 22 16:01:55.859280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 184/382] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:55 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:56.464981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:56.465662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:56.472378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:56.472866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:56.473304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:56.474020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:56.474467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:56.474897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:56.605127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:56.613806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:56.615307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:56.616514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e0f9031b-1ef9-441e-b84f-8ca91ba398a1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.155541 Aug 22 16:01:56.617064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 199/383] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:56 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:56.879414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:56.880031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:56.885929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:56.886414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:56.887520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:56.888215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:56.888674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:56.889102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:57.019392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:57.026991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-593dc634-edd7-4106-9c5c-c5fe9b1221d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.151545 Aug 22 16:01:57.027572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 185/384] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:56 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:57.640191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:57.640802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:57.647173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:57.647689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:57.648473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:57.649175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:57.649725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:57.650162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:57.784625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:57.794015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:57.795660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:57.796803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0c3c9200-7516-4757-9240-104e0f072a8a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1740 microversion: 2.20 time: 0.160583 Aug 22 16:01:57.797554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 200/385] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:57 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:58.048622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:58.049871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:58.056194 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:58.056692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:58.057135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:58.057847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:58.058308 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:58.059312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:58.221390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:58.228815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ab1f21d0-059d-4c62-a7e5-f2359e62f4e7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.184130 Aug 22 16:01:58.229758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 186/386] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:58 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:01:58.820280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:58.820892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:58.827797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:58.828275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:58.828709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:58.829397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:58.829846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:58.830268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:58.850777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:58.969687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:58.977793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:58.979788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:58.980987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3341a2e0-5c61-439b-bf9c-1b3e7d5ce96d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1722 microversion: 2.20 time: 0.164081 Aug 22 16:01:58.981569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 201/387] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:58 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:01:59.249849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:01:59.250409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:01:59.256385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:59.256869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:59.257308 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:59.258006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:01:59.258465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:01:59.258889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:01:59.393254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:01:59.400909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-abbcf01b-7e30-4c46-a095-aa0aac958bf8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.155035 Aug 22 16:01:59.401522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 187/388] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:01:59 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:00.004795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:00.005522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:00.012647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:00.013134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:00.013571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:00.014269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:00.014725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:00.015153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:00.141698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:00.149737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:00.151239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:00.152480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0d744ba5-b90a-44db-9913-87ccc0ea92bd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1722 microversion: 2.20 time: 0.151650 Aug 22 16:02:00.153039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 202/389] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:01:59 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:00.423164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:00.423721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:00.429652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:00.430134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:00.430567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:00.431258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:00.431740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:00.432273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:00.573531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:00.581264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-47046101-7c63-4147-8eb5-186a33e18dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.162059 Aug 22 16:02:00.581838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 188/390] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:00 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:01.175176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:01.175748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:01.178146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:01.183303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.183818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.184318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.185009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.185464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.185892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.315121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:01.323115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:01.325276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:01.326419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5364f2de-70eb-4875-b2b5-3c91dfc259a9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1725 microversion: 2.20 time: 0.155294 Aug 22 16:02:01.326965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 203/391] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:01 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:01.348546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bf690ac-7106-4a7f-9730-d39381f5a3cf"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:01.350909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:01.358146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.358635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.359067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.359791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.360268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.360691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.601837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:01.602475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:01.609078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.609552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.609982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.610668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.611119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.611566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.669705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8fe56b34-3be2-41dc-a991-d40898be2428 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325186 Aug 22 16:02:01.671536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 189/392] 10.222.0.40 () {62 vars in 1364 bytes} [Mon Aug 22 16:02:01 2022] POST /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 16:02:01.763834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:01.772128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-79dd1cfa-7f16-4e8f-a15e-7477016e7125 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.174011 Aug 22 16:02:01.772713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 204/393] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:01 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:02:01.804899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:01.805494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:01.812950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.813477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.814138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.814853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.815310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.815762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.864738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121080) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 16:02:01.898643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-94911894-2eec-46dc-ae1b-1c70af81db49 req-ccae4db3-ff31-4847-9337-c94158e5c7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b", "name": "network-vif-plugged", "status": "completed", "tag": "1de14c98-3830-4ed5-8d8d-c98cefc71394"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:01.918802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-94911894-2eec-46dc-ae1b-1c70af81db49 req-ccae4db3-ff31-4847-9337-c94158e5c7fc service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.919661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-94911894-2eec-46dc-ae1b-1c70af81db49 req-ccae4db3-ff31-4847-9337-c94158e5c7fc service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.920345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-94911894-2eec-46dc-ae1b-1c70af81db49 req-ccae4db3-ff31-4847-9337-c94158e5c7fc service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.927510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:01.933679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-94911894-2eec-46dc-ae1b-1c70af81db49 req-ccae4db3-ff31-4847-9337-c94158e5c7fc service nova] Creating event network-vif-plugged:1de14c98-3830-4ed5-8d8d-c98cefc71394 for instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b on hv-cinder-85400 Aug 22 16:02:01.939045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-94911894-2eec-46dc-ae1b-1c70af81db49 req-ccae4db3-ff31-4847-9337-c94158e5c7fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044246 Aug 22 16:02:01.940316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 205/394] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:02:01.943173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1545e8a8-0998-45c9-a040-844cb405435a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/action" status: 202 len: 0 microversion: 2.20 time: 0.142193 Aug 22 16:02:01.944007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 190/395] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Aug 22 16:02:01 2022] POST /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 16:02:01.953315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:01.954094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:01.961165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.961835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.962495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:01.963209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:01.963816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:01.964307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:02.116721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:02.126239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:02.128974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:02.130423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-daec4542-6885-44ae-b93e-8abb5cdef098 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1751 microversion: 2.20 time: 0.181915 Aug 22 16:02:02.132234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 206/396] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:01 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:02.797263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:02.798095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:02.804643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:02.805176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:02.805621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:02.806327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:02.806771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:02.807199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:02.947970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:02.955902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bc616102-368c-412d-a571-579c20af38bf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.165611 Aug 22 16:02:02.956505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 191/397] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:02 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:03.155536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:03.156113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:03.163537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:03.164081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:03.164531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:03.165314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:03.165777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:03.166205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:03.300398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:03.309267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:03.310888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:03.312088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c41daacb-980c-4532-a10d-ba19b5ea7931 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1751 microversion: 2.20 time: 0.161928 Aug 22 16:02:03.312654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 207/398] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:03 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:03.975581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-fc1398ed-3aa7-4b79-8351-c1095841e55a req-760651bf-42ec-48e5-88f5-1cf6afcddc52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6012e-3710-4ea5-9cfa-7e0e34321caf", "name": "network-vif-unplugged", "status": "completed", "tag": "f9c81dc7-a34c-438c-8a49-f74d23ef8f2f"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:03.977109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:03.977721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:03.984236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:03.984714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:03.985164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:03.985572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fc1398ed-3aa7-4b79-8351-c1095841e55a req-760651bf-42ec-48e5-88f5-1cf6afcddc52 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:03.985857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:03.986051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fc1398ed-3aa7-4b79-8351-c1095841e55a req-760651bf-42ec-48e5-88f5-1cf6afcddc52 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:03.986311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:03.986483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fc1398ed-3aa7-4b79-8351-c1095841e55a req-760651bf-42ec-48e5-88f5-1cf6afcddc52 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:03.986733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:03.998317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.compute.server_external_events [req-fc1398ed-3aa7-4b79-8351-c1095841e55a req-760651bf-42ec-48e5-88f5-1cf6afcddc52 service nova] Unable to find a host for instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf. Dropping event network-vif-unplugged {{(pid=121080) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 16:02:03.999577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-fc1398ed-3aa7-4b79-8351-c1095841e55a req-760651bf-42ec-48e5-88f5-1cf6afcddc52 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027779 Aug 22 16:02:04.000292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 192/399] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 22 16:02:04.135208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:04.143271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f59617b1-4ef9-455f-a10f-2e8fcf7958ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1265 microversion: 2.1 time: 0.169938 Aug 22 16:02:04.143871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 208/400] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:03 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:02:04.335497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:04.336041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:04.342022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:04.342494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:04.342924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:04.343647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:04.344328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:04.344789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:04.480581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:04.489499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:04.491004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:04.492184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7815ace7-45e9-4ac2-af7a-5fa53668e120 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1753 microversion: 2.20 time: 0.160899 Aug 22 16:02:04.492739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 193/401] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:04 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:05.164108 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:05.165584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:05.181732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:05.182226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:05.182693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:05.183409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:05.183951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:05.184670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:05.320309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:05.329362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3f80409b-0f52-4a00-a9fd-bd6d6dc0aaeb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1451 microversion: 2.1 time: 0.169350 Aug 22 16:02:05.329937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 209/402] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:05 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:05.349770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:05.350378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:05.356316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:05.357314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:05.358025 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:05.358712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:05.359161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:05.359605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:05.491763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:05.499943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0c389254-5c31-45e4-90c8-0f584655bcb9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1451 microversion: 2.1 time: 0.154017 Aug 22 16:02:05.500504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 194/403] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:05 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:05.515882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:05.516533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:05.522711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:05.523032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:05.523500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:05.524201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:05.524655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:05.525076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:05.670547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:05.679474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:05.681121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:05.682370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8b526186-5f63-4d36-ba76-d9b7b7c89345 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.170420 Aug 22 16:02:05.683003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 210/404] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:05 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:06.706280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:06.707015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:06.713395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:06.713886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:06.714326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:06.715068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:06.715551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:06.716009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:07.000453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:07.013253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:07.014909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:07.016135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6cd4eff3-1d34-4be4-b2f0-22fc4a884f16 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.314046 Aug 22 16:02:07.016868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 195/405] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:06 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:02:07.658747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-812e1690-7d74-4ca8-a6c1-b25d699e8527 req-03ccb1a8-8702-48bb-bd59-6f26ac1583c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b", "tag": "1de14c98-3830-4ed5-8d8d-c98cefc71394"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:07.670809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-812e1690-7d74-4ca8-a6c1-b25d699e8527 req-03ccb1a8-8702-48bb-bd59-6f26ac1583c8 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:07.671677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-812e1690-7d74-4ca8-a6c1-b25d699e8527 req-03ccb1a8-8702-48bb-bd59-6f26ac1583c8 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:07.672116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-812e1690-7d74-4ca8-a6c1-b25d699e8527 req-03ccb1a8-8702-48bb-bd59-6f26ac1583c8 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:07.684301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-812e1690-7d74-4ca8-a6c1-b25d699e8527 req-03ccb1a8-8702-48bb-bd59-6f26ac1583c8 service nova] Creating event network-changed:1de14c98-3830-4ed5-8d8d-c98cefc71394 for instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b on hv-cinder-85400 Aug 22 16:02:07.689351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-812e1690-7d74-4ca8-a6c1-b25d699e8527 req-03ccb1a8-8702-48bb-bd59-6f26ac1583c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034251 Aug 22 16:02:07.689989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 211/406] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:08.039465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:08.040851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:08.049486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:08.050250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:08.050841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:08.051744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:08.052532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:08.053120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:08.227511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:08.237213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:08.239169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:08.240453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-54f4149b-d146-4294-bb8e-05d469e8a32b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.205276 Aug 22 16:02:08.241084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 196/407] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:08 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:09.265837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:09.266456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:09.273315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:09.273802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:09.274242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:09.274950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:09.275440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:09.275873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:09.628094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:09.637118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:09.639266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:09.640455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a4073a52-7dc3-42aa-a435-3c5c288ef852 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.379521 Aug 22 16:02:09.641023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 212/408] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:09 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:10.663621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:10.664234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:10.671408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:10.671820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:10.672261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:10.672972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:10.673433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:10.673859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:10.810700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:10.820175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:10.823124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:10.824394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8163d841-5432-4e6a-895f-70d2fe82590c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.164733 Aug 22 16:02:10.824955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 197/409] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:10 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:11.294084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:11.294817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:11.301392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:11.301879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:11.302317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:11.303019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:11.303507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:11.303932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:11.329086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cf477325-9036-4920-ad2d-48bc71e71fd0 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/ips" status: 200 len: 146 microversion: 2.1 time: 0.038793 Aug 22 16:02:11.329666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 213/410] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 16:02:11 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:11.847656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:11.848250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:11.854375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:11.854862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:11.855299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:11.856032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:11.856491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:11.856917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:11.991971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:12.001426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:12.002951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:12.004186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2d799503-84d5-447f-99b3-be631cd8ec61 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.160447 Aug 22 16:02:12.005116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 198/411] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:11 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:13.028706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:13.030002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:13.036278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:13.036769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:13.037211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:13.037917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:13.038378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:13.038825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:13.183741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:13.193651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:13.195176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:13.196816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f1ea4544-de21-4d5a-9919-29b96e862e11 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.172525 Aug 22 16:02:13.199229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 214/412] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:13 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:14.220983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:14.221561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:14.227702 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:14.228179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:14.228606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:14.229293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:14.229740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:14.230167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:14.374008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:14.388383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:14.391165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:14.393612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-47ec578c-14d8-42a0-94d6-22f763f2ed73 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.176152 Aug 22 16:02:14.394942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 199/413] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:14 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:15.425149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:15.425758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:15.432810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:15.433569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:15.434275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:15.435148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:15.435781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:15.436357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:15.580467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:15.590177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:15.592020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:15.593331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-53f5c8b4-8638-43b2-9605-8ccc82b1c014 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.172345 Aug 22 16:02:15.593994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 215/414] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:15 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:16.257925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad366b0c-3940-406b-b6e0-6ce0fd3ddea1"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:16.260388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:16.267273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:16.267918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:16.268386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:16.269170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:16.269623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:16.270050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:16.617416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:16.618022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:16.624896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:16.625382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:16.625824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:16.626558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:16.627013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:16.627479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:16.763135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:16.772350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:16.774029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:16.776119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f50f3eed-d402-42bf-8990-e25d8302915c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.162723 Aug 22 16:02:16.777011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 216/415] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:16 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:02:17.799902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:17.800597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:17.806962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:17.807513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:17.808142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:17.808850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:17.809334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:17.809789 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:17.951830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:17.961212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:17.963066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:17.964371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-38b61830-cdf5-4785-831d-07e8e118c1ef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.168490 Aug 22 16:02:17.965035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 217/416] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:17 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:02:18.988210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:18.988886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:18.995322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:18.998080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:18.998080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:18.998080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:18.998080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:18.998444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:19.153618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:19.164019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:19.165549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:19.166708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-975001b8-a2b8-4af2-abcd-bdf2c0b22f77 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.182489 Aug 22 16:02:19.167273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 218/417] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:18 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:02:19.169520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-140e6f6a-3a00-47a8-a2d9-a5edb04381b6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.915383 Aug 22 16:02:19.170118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 200/418] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:02:16 2022] POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/os-volume_attachments => generated 194 bytes in 2917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:02:20.191507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:20.192114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:20.198665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:20.199150 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:20.199656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:20.200335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:20.200807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:20.201217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:20.332986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:20.336655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:20.343354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:20.344837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:20.346009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b87625f3-0c89-436a-9fe7-884e95f6cba1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.158551 Aug 22 16:02:20.346562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 219/419] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:20 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:21.372653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:21.373349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:21.380504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:21.380980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:21.381416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:21.382105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:21.382554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:21.382979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:21.515099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:21.523712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:21.525209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:21.526352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1259bb8a-5023-4795-84d7-1af50e1eb906 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.157912 Aug 22 16:02:21.526904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 201/420] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:21 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:22.550899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:22.551559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:22.558166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:22.558654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:22.559087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:22.559810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:22.560268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:22.560701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:22.697182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:22.705762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:22.707542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:22.708704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2c85bf81-5cc8-428f-9432-67845db77074 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.161983 Aug 22 16:02:22.709253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 220/421] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:22 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:23.731758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:23.732306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:23.738656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:23.739131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:23.739614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:23.740301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:23.740753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:23.741172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:23.872575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:23.881709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:23.883237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:23.884405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f79b509e-7a8b-4a07-84fc-a19c7fee97ca tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.156634 Aug 22 16:02:23.884972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 202/422] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:23 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:24.908654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:24.909247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:24.915767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:24.916248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:24.916686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:24.917388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:24.917842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:24.918269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:25.049307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:25.057790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:25.059274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:25.060450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-893a35a7-ab04-4858-82f9-c0ba58a5419a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.156394 Aug 22 16:02:25.060998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 221/423] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:24 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:26.082697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:26.083354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:26.085875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:26.091217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:26.091720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:26.092166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:26.092863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:26.093814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:26.094250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:26.225677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:26.234893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:26.236457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:26.237612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-240d309a-0905-46fa-a67c-89c93d61a15a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.159514 Aug 22 16:02:26.238175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 203/424] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:26 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:27.261695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:27.262408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:27.269421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:27.269898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:27.270338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:27.271029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:27.271518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:27.271944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:27.399899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:27.408970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:27.410494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:27.411713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a5473901-1820-4dd8-a13e-b62226397aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.154928 Aug 22 16:02:27.412270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 222/425] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:27 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:27.748246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9807dbfe-6f63-4684-9249-1da12d3d3fca tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:27.755352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9807dbfe-6f63-4684-9249-1da12d3d3fca tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:27.755854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9807dbfe-6f63-4684-9249-1da12d3d3fca tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:27.756290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9807dbfe-6f63-4684-9249-1da12d3d3fca tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:27.816491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9807dbfe-6f63-4684-9249-1da12d3d3fca tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Going to try to stop instance {{(pid=121080) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 16:02:27.860396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9807dbfe-6f63-4684-9249-1da12d3d3fca tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/action" status: 202 len: 0 microversion: 2.1 time: 0.115860 Aug 22 16:02:27.861169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 204/426] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:02:27 2022] POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:02:27.868983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:27.869694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:27.876678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:27.877161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:27.877595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:27.878426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:27.879043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:27.879488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:28.010546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:28.020017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d8d6031f-ad37-405a-9c6c-9a32d99c0613 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.154837 Aug 22 16:02:28.020849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 223/427] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:27 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:28.435048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:28.435699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:28.442191 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:28.442676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:28.443113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:28.443855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:28.444303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:28.444733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:28.580166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:28.583947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:28.590082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:28.591545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:28.592704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6d0bf394-19b6-4a16-8cf5-59a1498aa5be tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.162070 Aug 22 16:02:28.593852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 205/428] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:28 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:29.041923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:29.042617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:29.049093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:29.049559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:29.049999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:29.050687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:29.051147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:29.051610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:29.180901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:29.189514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c80201f6-fbc4-40e2-a41c-32c403149c8c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.151440 Aug 22 16:02:29.190078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 224/429] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:29 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:29.617507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:29.618599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:29.626867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:29.627409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:29.627846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:29.628550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:29.629049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:29.629458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:29.763593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:29.772603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:29.774109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:29.775283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2cf4333d-5fe0-49a8-9ea6-e15698091206 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.161702 Aug 22 16:02:29.775869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 206/430] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:29 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:30.005510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-b0dbf97c-db4b-4ed8-b722-98946e6d330b req-57d3bfdc-fa59-48a7-8165-e00ef51350fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6012e-3710-4ea5-9cfa-7e0e34321caf", "name": "network-vif-plugged", "status": "completed", "tag": "f9c81dc7-a34c-438c-8a49-f74d23ef8f2f"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:30.015979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b0dbf97c-db4b-4ed8-b722-98946e6d330b req-57d3bfdc-fa59-48a7-8165-e00ef51350fa service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:30.016659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b0dbf97c-db4b-4ed8-b722-98946e6d330b req-57d3bfdc-fa59-48a7-8165-e00ef51350fa service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:30.017098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b0dbf97c-db4b-4ed8-b722-98946e6d330b req-57d3bfdc-fa59-48a7-8165-e00ef51350fa service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:30.028034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-b0dbf97c-db4b-4ed8-b722-98946e6d330b req-57d3bfdc-fa59-48a7-8165-e00ef51350fa service nova] Creating event network-vif-plugged:f9c81dc7-a34c-438c-8a49-f74d23ef8f2f for instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf on hv-cinder-85400 Aug 22 16:02:30.033009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-b0dbf97c-db4b-4ed8-b722-98946e6d330b req-57d3bfdc-fa59-48a7-8165-e00ef51350fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031327 Aug 22 16:02:30.033604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 225/431] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:30.210882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:30.211524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:30.217512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:30.222083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:30.222083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:30.222083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:30.222083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:30.222474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:30.356023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:30.364739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2119bc7c-c3fd-46ca-92da-0e0f738abfd5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.157902 Aug 22 16:02:30.365345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 207/432] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:30 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:30.800449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:30.801089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:30.807440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:30.807934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:30.808365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:30.809071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:30.809539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:30.809962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:30.944950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:30.954189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:30.955726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:30.956903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7209acf-0d80-4454-8475-7fa73db916d0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.161840 Aug 22 16:02:30.957738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 226/433] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:30 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:31.385958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:31.386575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:31.393264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:31.393755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:31.394193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:31.394903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:31.395385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:31.395817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:31.536768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:31.545544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1bc9b5bc-b23a-41e7-815e-1c41f3213140 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.163380 Aug 22 16:02:31.546127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 208/434] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:31 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:31.980617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:31.981165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:31.983770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=48 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:31.991667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:31.992213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:31.992708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:31.993467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:31.994186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:31.994662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:32.143362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:32.152354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:32.153865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:32.155068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-92e9ec1b-504b-421a-a049-788be4a7c872 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.178532 Aug 22 16:02:32.155654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 227/435] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:31 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:32.572582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:32.574253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:32.583103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:32.583700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:32.584089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:32.584837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:32.585486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:32.585911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:32.729433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:32.739262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e0b67cee-51ed-4a4d-8321-08ac54b8e143 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.170544 Aug 22 16:02:32.739888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 209/436] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:32 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:33.178650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:33.179257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:33.185876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:33.186355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:33.186793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:33.188118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:33.188574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:33.188999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:33.320251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:33.329481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:33.331030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:33.332491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5950bf38-4466-477d-9c4a-53ac496f1bf3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1809 microversion: 2.20 time: 0.157546 Aug 22 16:02:33.333065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 228/437] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:33 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:33.761307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:33.762201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:33.768747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:33.769220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:33.769699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:33.770413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:33.770871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:33.771299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:33.907753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:33.917225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-28ac2f2f-136a-4ad7-a897-3c2cc16a5816 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.160215 Aug 22 16:02:33.917787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 210/438] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:33 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:34.356013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:34.356627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:34.363714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:34.364202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:34.364639 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:34.365338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:34.365795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:34.366206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:34.499038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:34.508374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:34.509883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:34.511044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d3e168b1-0e1c-4b69-a0f4-f8182229d8ea tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1796 microversion: 2.20 time: 0.158964 Aug 22 16:02:34.511626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 229/439] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:02:34 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:02:34.939987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:34.940601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:34.947097 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:34.947624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:34.948066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:34.948772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:34.949233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:34.949661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:35.082479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:35.091602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c372fd4d-212a-452d-af93-797964542914 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.155938 Aug 22 16:02:35.092176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 211/440] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:34 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:36.112742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:36.113354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:36.119905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:36.120394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:36.120834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:36.121538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:36.121996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:36.122424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:36.257188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:36.265801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cf789a3d-e77d-45da-bf9a-0e42ff08ce06 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.156825 Aug 22 16:02:36.266922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 230/441] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:36 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:37.288659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:37.289283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:37.296029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:37.296517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:37.296955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:37.298280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:37.298734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:37.299163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:37.441886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:37.450444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-59199093-766d-442c-a21e-2eb3a2319b76 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.165503 Aug 22 16:02:37.451025 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 212/442] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:37 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:38.473486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:38.474097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:38.480900 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:38.481387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:38.481820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:38.482521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:38.482972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:38.483416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:38.625644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:38.634344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f8dd873b-59d3-42b6-ae49-a87f20a2034f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.164716 Aug 22 16:02:38.634904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 231/443] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:38 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:39.656469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:39.657836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:39.664821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:39.665317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:39.665759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:39.666464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:39.666922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:39.667352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:39.802181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:39.810704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-998f8516-3bcc-42ac-a608-86e1a88698f1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.158305 Aug 22 16:02:39.811291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 213/444] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:39 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:40.739070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:40.739785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:40.746835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:40.747390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:40.747839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:40.748541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:40.748995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:40.749416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:40.774966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cd7e53ed-6caf-4bb4-ad84-3329d7ba1241 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48/ips" status: 200 len: 150 microversion: 2.1 time: 0.039739 Aug 22 16:02:40.775605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 232/445] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 16:02:40 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:40.788107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc51a1ed-444c-493e-b0a1-fb6eb0a9082f"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:40.790686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:40.797589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:40.798077 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:40.798514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:40.799231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:40.799721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:40.800148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:40.833084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:40.833692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:40.839882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:40.840371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:40.840809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:40.841506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:40.841968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:40.842604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:40.892213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Invalid volume: volume dc51a1ed-444c-493e-b0a1-fb6eb0a9082f is already attached to instances: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: POST /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48/os-volume_attachments HTTP/1.1 Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 74 Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:02:40.893967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {"volumeAttachment": {"volumeId": "dc51a1ed-444c-493e-b0a1-fb6eb0a9082f"}} Aug 22 16:02:40.895635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Invalid volume: volume dc51a1ed-444c-493e-b0a1-fb6eb0a9082f is already attached to instances: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'server_id': '8b535aef-666c-4f54-896d-e94dc94dee48', 'body': {'volumeAttachment': {'volumeId': 'dc51a1ed-444c-493e-b0a1-fb6eb0a9082f'}}} Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dc51a1ed-444c-493e-b0a1-fb6eb0a9082f is already attached to instances: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:02:40.896381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dc51a1ed-444c-493e-b0a1-fb6eb0a9082f is already attached to instances: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:02:40.897537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:02:40.899147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:02:40.899147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:02:40.899147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:02:40.899147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dc51a1ed-444c-493e-b0a1-fb6eb0a9082f is already attached to instances: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 Aug 22 16:02:40.899147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:02:40.899147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 400 to user: Invalid volume: volume dc51a1ed-444c-493e-b0a1-fb6eb0a9082f is already attached to instances: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:02:40.899147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-644678fb-742b-4fde-89b0-15c2612aea00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111628 Aug 22 16:02:40.899147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 214/446] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:02:40 2022] POST /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 16:02:40.910583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:40.911527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:40.923077 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:40.923994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:40.924802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:40.926537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:40.926911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:40.927721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:40.968156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:02:40.982484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:40.990943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2628538c-84a0-4a80-86d9-089c20411159 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.162782 Aug 22 16:02:40.991541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 233/447] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:40 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:02:41.054681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f3901a22-dbf8-4e30-96e4-7aabb770b38a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 204 len: 0 microversion: 2.1 time: 0.151071 Aug 22 16:02:41.055205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 215/448] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:02:40 2022] DELETE /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 16:02:41.063869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:41.064835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:41.072804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:41.073425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:41.073986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:41.074834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:41.075413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:41.075991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:41.227103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:41.235792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e13483aa-6cb0-4626-8a6c-68a940f19133 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1682 microversion: 2.1 time: 0.175692 Aug 22 16:02:41.236382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 234/449] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:41 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:02:42.013586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:42.014323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:42.021606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:42.022094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:42.022535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:42.023266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:42.023822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:42.024244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:42.167007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:42.175872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4b36a067-b61d-4079-8e31-9a149e4f5202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.166613 Aug 22 16:02:42.176444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 216/450] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:42 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:42.260541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:42.261534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:42.272818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:42.273560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:42.274298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:42.275558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:42.276367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:42.277103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:42.429949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:42.440862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-301e3af0-7c6e-492b-b7bb-065e150bf01d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1682 microversion: 2.1 time: 0.186674 Aug 22 16:02:42.441610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 235/451] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:42 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:43.197545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:43.198201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:43.205216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:43.205703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:43.206131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:43.206837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:43.207687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:43.208102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:43.350231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:43.358980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6e77071a-38b8-4bd2-95d6-d37ad705a91f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.165352 Aug 22 16:02:43.360544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 217/452] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:43 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:43.464401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:43.465006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:43.471933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:43.472417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:43.472849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:43.473546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:43.473994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:43.474411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:43.636385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:43.645557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b99117b8-7879-4e12-b262-08987242d486 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1682 microversion: 2.1 time: 0.184793 Aug 22 16:02:43.645768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 236/453] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:43 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:44.384526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:44.386751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:44.398302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:44.399582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:44.400348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:44.401550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:44.402347 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:44.402939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:44.550584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:44.561988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e20ade4a-905c-423a-988a-0314d2228ffb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.183074 Aug 22 16:02:44.575494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 218/454] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:44 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:44.670891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:44.672230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:44.681785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:44.682292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:44.682719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:44.683482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:44.683946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:44.684377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:44.710791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:44.760657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:44.768867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ecd188eb-e535-4e55-a79f-02506a63b7a2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1614 microversion: 2.1 time: 0.103419 Aug 22 16:02:44.769481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 237/455] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:44 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:44.968491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-52a2ce25-6df6-44a9-84d6-f0de76624bb9 req-7d743311-1ae8-4ab4-99c0-c7efdff9777c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b535aef-666c-4f54-896d-e94dc94dee48", "name": "network-vif-deleted", "tag": "1d848c57-654a-40af-89f7-77830671bb9c"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:44.981335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-52a2ce25-6df6-44a9-84d6-f0de76624bb9 req-7d743311-1ae8-4ab4-99c0-c7efdff9777c service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:44.984375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-52a2ce25-6df6-44a9-84d6-f0de76624bb9 req-7d743311-1ae8-4ab4-99c0-c7efdff9777c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:44.984860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-52a2ce25-6df6-44a9-84d6-f0de76624bb9 req-7d743311-1ae8-4ab4-99c0-c7efdff9777c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:44.999531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-52a2ce25-6df6-44a9-84d6-f0de76624bb9 req-7d743311-1ae8-4ab4-99c0-c7efdff9777c service nova] Creating event network-vif-deleted:1d848c57-654a-40af-89f7-77830671bb9c for instance 8b535aef-666c-4f54-896d-e94dc94dee48 on hv-cinder-85400 Aug 22 16:02:45.006034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-52a2ce25-6df6-44a9-84d6-f0de76624bb9 req-7d743311-1ae8-4ab4-99c0-c7efdff9777c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041134 Aug 22 16:02:45.006641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 219/456] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:02:45.587618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:45.588248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:45.594855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:45.595662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:45.596255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:45.597119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:45.597731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:45.598309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:45.784023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:45.793579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:45.795088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:45.803665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:45.804799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:45.805434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:45.806334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:45.806957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:45.807942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:45.811574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e8448dba-8afe-4977-b3d0-a078fd2e993f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.229537 Aug 22 16:02:45.844242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 238/457] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:45 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:45.846185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:45.846686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:45.847138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:45.847631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lazy-loading 'fault' on Instance uuid 8b535aef-666c-4f54-896d-e94dc94dee48 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:02:45.916491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:45.925944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4fb2ff14-f169-4ce4-baab-c6988278fdd6 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 200 len: 1331 microversion: 2.1 time: 0.138868 Aug 22 16:02:45.927210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 220/458] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:45 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:46.618345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82d4a78e-b44b-4480-9d1b-1e3a72c606f1"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:46.620832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:46.628105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:46.628597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:46.629039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:46.629751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:46.630207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:46.630631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:46.847461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:46.848103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:46.854580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:46.855862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:46.856381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:46.857099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:46.857750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:46.858182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:46.863438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:46.937327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-be298cd9-95e8-4d33-b301-7b02e0b6250f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322815 Aug 22 16:02:46.938373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 239/459] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:02:46 2022] POST /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:46.955963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:46.959860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:46.971302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:46.971825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:46.972475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:46.973383 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:46.974238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:46.975267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:46.994622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 HTTP/1.1 Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:02:46.997289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:02:46.998922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '8b535aef-666c-4f54-896d-e94dc94dee48'} Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:02:47.000014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:02:47.002415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:02:47.004511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:02:47.004511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f20dc7f7-725f-4abd-8be1-c5a783a05100 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 404 len: 111 microversion: 2.1 time: 0.056508 Aug 22 16:02:47.004511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 240/460] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:46 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:02:47.012159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-268ea765-de70-452a-9bf8-d8c893463c74 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '.version_select at 0x7fec9c28caf0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:47.020775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:47.029219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a9b3840e-8884-4f82-b682-a991b55eaed7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.186053 Aug 22 16:02:47.029969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 221/461] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:46 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:02:47.037087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-268ea765-de70-452a-9bf8-d8c893463c74 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217255009" status: 202 len: 0 microversion: 2.1 time: 0.028989 Aug 22 16:02:47.037673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 241/462] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 22 16:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217255009 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 16:02:47.832791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:47.833286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:47.840100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:47.840617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:47.841043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:47.841736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:47.842181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:47.842600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:47.979074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lazy-loading 'services' on Instance uuid 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:02:48.054544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:48.055619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:48.065474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:48.065974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:48.066417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:48.067357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:48.068086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:48.068458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:48.116656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a9ac5178-ba7a-4488-a9fa-76052c4cc850 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments/dc51a1ed-444c-493e-b0a1-fb6eb0a9082f" status: 202 len: 0 microversion: 2.1 time: 0.288543 Aug 22 16:02:48.117816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 222/463] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:02:47 2022] DELETE /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments/dc51a1ed-444c-493e-b0a1-fb6eb0a9082f => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:02:48.128094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:48.130470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:48.138085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:48.138580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:48.139024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:48.139830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:48.140432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:48.140894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:48.199942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a384676c-14c7-46a5-ad39-c847c883fe0e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076740 Aug 22 16:02:48.200711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 223/464] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:02:48 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:02:48.247013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:48.256237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fbe9d5e1-c0a4-48af-a499-c4d14fab8d5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1722 microversion: 2.1 time: 0.208770 Aug 22 16:02:48.256805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 242/465] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:48 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:49.213069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:49.215422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:49.221972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:49.222455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:49.222896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:49.223625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:49.224083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:49.224510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:49.254757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b1ee5e5c-c3c8-4243-97c3-677542720749 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045658 Aug 22 16:02:49.255315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 224/466] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:02:49 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:49.278088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:49.278715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:49.285423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:49.285905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:49.286343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:49.287048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:49.287608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:49.288039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:49.424580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:49.433136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-acff97a9-c432-4a2a-b52b-b443408efb5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1699 microversion: 2.1 time: 0.158859 Aug 22 16:02:49.433709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 243/467] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:49 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:49.455197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a2451859-1576-440e-894f-6cc056587e4b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:49.461598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2451859-1576-440e-894f-6cc056587e4b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:49.462082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2451859-1576-440e-894f-6cc056587e4b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:49.462508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2451859-1576-440e-894f-6cc056587e4b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:49.485735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a2451859-1576-440e-894f-6cc056587e4b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Going to try to start instance {{(pid=121080) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 16:02:49.530475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a2451859-1576-440e-894f-6cc056587e4b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/action" status: 202 len: 0 microversion: 2.1 time: 0.079960 Aug 22 16:02:49.531073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 225/468] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:02:49 2022] POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:02:49.540210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:49.541919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:49.548686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:49.549177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:49.549622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:49.550530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:49.550979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:49.551463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:49.689412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:49.697800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-047eaccc-f2f4-4b70-b549-dd1dfd519579 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1708 microversion: 2.1 time: 0.161734 Aug 22 16:02:49.698374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 244/469] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:49 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:50.267692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:50.270009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:50.276224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:50.276713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:50.277147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:50.277844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:50.278296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:50.278717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:50.308339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a923e4e3-fdfc-4137-ad3f-1a12e20ac69b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Aug 22 16:02:50.308884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 226/470] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:02:50 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:50.719923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:50.720536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:50.727201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:50.727732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:50.728167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:50.728873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:50.729337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:50.729763 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:50.863858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:50.873274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a8297b1e-fa27-4bc4-96df-17ac59ac398a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1708 microversion: 2.1 time: 0.156667 Aug 22 16:02:50.873274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 245/471] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:50 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:51.321443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:51.323681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:51.330614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:51.331099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:51.331565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:51.332516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:51.332977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:51.333404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:51.362205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e4cab33-fe65-4f62-bc91-6403f90ea80e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Aug 22 16:02:51.362746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 227/472] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:02:51 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:51.894184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:51.894821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:51.901363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:51.901854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:51.902288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:51.903154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:51.903871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:51.904295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:52.039234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:52.048205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b9f8502-eb84-48f2-834c-1681a6a7b17a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1712 microversion: 2.1 time: 0.158155 Aug 22 16:02:52.048764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 246/473] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:51 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:52.373817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:52.375947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:52.382325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:52.382801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:52.383232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:52.383951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:52.384400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:52.384820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:52.415522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2baa00e1-18ac-40c4-9b4a-5d7f43d443eb tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Aug 22 16:02:52.416073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 228/474] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:02:52 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:53.427792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:53.430060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:53.436704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:53.437194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:53.437688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:53.438930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:53.439446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:53.439844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:53.470427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9b2e51e8-ddae-45e0-bd84-26be2a88717b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046572 Aug 22 16:02:53.471002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 247/475] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:02:53 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:54.482128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:54.485230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:54.489778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:54.491845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:54.492096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:54.492464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:54.492967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:54.493726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:54.494189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:54.494609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:54.498629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:54.499117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:54.499595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:54.500291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:54.500748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:54.501173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:54.523872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7861f06c-fcd1-43e3-a816-f5ee857b155e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Aug 22 16:02:54.524681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 229/476] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:02:54 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:54.524946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lazy-loading 'flavor' on Instance uuid 9341c753-156a-4cf4-82d1-be8cbb188892 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:02:54.650314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-287b86cc-cb5a-4aa8-ae5b-890d77c761f6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/action" status: 200 len: 32 microversion: 2.1 time: 0.164481 Aug 22 16:02:54.650985 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 248/477] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:02:54 2022] POST /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 16:02:54.661408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:54.662045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:54.668005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:54.668484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:54.668920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:54.669621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:54.670067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:54.670492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:54.805565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:54.814006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f0bd0cc7-0f68-4162-9a26-6362fe365898 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.156439 Aug 22 16:02:54.814572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 230/478] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:54 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:55.537893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:55.540686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:55.547604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:55.548882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:55.549330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:55.550054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:55.550510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:55.550931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:55.587948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-096121d8-e138-4aeb-9aa9-b30954cad304 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055075 Aug 22 16:02:55.588909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 249/479] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:02:55 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 16:02:55.669093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:55.669823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:55.676760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:55.677352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:55.677791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:55.678771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:55.679209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:55.679666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:55.708867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:02:55.790690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-efceb475-5e87-4e83-8d0b-94c4d392a81f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 204 len: 0 microversion: 2.1 time: 0.125515 Aug 22 16:02:55.791269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 231/480] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:02:55 2022] DELETE /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:02:55.799527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:55.800134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:55.806056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:55.806530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:55.806956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:55.807693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:55.808141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:55.808560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:55.835687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:55.836416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:55.842653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:55.843132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:55.843591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:55.845013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:55.845528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:55.845878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:55.990948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:55.998903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-62fe0a13-24fd-419d-9f3a-8745dc52d0ab tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1683 microversion: 2.1 time: 0.203148 Aug 22 16:02:55.999498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 250/481] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:55 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:56.018227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:56.026621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-32c36769-0fb3-4abb-b763-a368d0605fd3 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.195840 Aug 22 16:02:56.027187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 232/482] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:55 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:02:57.019470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:57.020089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:57.026603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:57.027085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:57.027570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:57.028270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:57.028729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:57.029158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:57.047982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:57.048584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:57.051000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:57.056443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:57.056930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:57.057375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:57.058073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:57.058524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:57.058947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:57.231779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:57.235374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:57.240969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f486bce-3f14-43fe-975b-d6484cab7816 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1683 microversion: 2.1 time: 0.225334 Aug 22 16:02:57.241544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 251/483] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:57 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:57.243648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f20117d2-d41c-4b7d-b18d-d2b5a847fdce tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.199952 Aug 22 16:02:57.244209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 233/484] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:57 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:02:58.262857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:58.263420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:58.264946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:58.266149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:58.271795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:58.272520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:58.272799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:58.273167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:58.273363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:58.273808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:58.273942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:58.274603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:58.274759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:58.275016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:58.275211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:58.275553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:58.294187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:58.294435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:58.477048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:58.480654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:58.486194 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bfda1fa7-66e1-4dea-863c-6d85fe89f2ac tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.225021 Aug 22 16:02:58.487237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 234/485] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:58 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:58.489251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a69dbbc8-0e62-4bb5-addf-8449eeac1e3c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1683 microversion: 2.1 time: 0.230315 Aug 22 16:02:58.489984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 252/486] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:58 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1683 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:59.510085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:59.510795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:59.515280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:02:59.516573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:02:59.521755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:59.522346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:59.522862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:59.523680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:59.523958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:59.524516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:59.524643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:59.525093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:59.525219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:59.525918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:59.526443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:59.527084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:59.637556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:59.649479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-231a0b6e-c9c8-4056-ab00-28a3f46565be tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 200 len: 1615 microversion: 2.1 time: 0.140256 Aug 22 16:02:59.664109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 253/487] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:59 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 1615 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:02:59.673269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-7e498dac-117a-4c51-8f4a-aa461698fedb req-f56ee7fd-b3fb-4d62-ad53-0a4719622a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cbc6b6e-511f-4f80-8f1c-10fc819eb319", "name": "network-vif-deleted", "tag": "cfed9e3e-cded-427a-b9ac-9070c083cfb4"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:02:59.685591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-7e498dac-117a-4c51-8f4a-aa461698fedb req-f56ee7fd-b3fb-4d62-ad53-0a4719622a00 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:02:59.686081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-7e498dac-117a-4c51-8f4a-aa461698fedb req-f56ee7fd-b3fb-4d62-ad53-0a4719622a00 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:02:59.686524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-7e498dac-117a-4c51-8f4a-aa461698fedb req-f56ee7fd-b3fb-4d62-ad53-0a4719622a00 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:02:59.700792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-7e498dac-117a-4c51-8f4a-aa461698fedb req-f56ee7fd-b3fb-4d62-ad53-0a4719622a00 service nova] Creating event network-vif-deleted:cfed9e3e-cded-427a-b9ac-9070c083cfb4 for instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 on hv-cinder-85400 Aug 22 16:02:59.709718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-7e498dac-117a-4c51-8f4a-aa461698fedb req-f56ee7fd-b3fb-4d62-ad53-0a4719622a00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056890 Aug 22 16:02:59.710425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 254/488] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:02:59.741122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:02:59.758658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d86356f8-d6c2-4acc-880f-8991968462d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.255005 Aug 22 16:02:59.760085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 235/489] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:02:59 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:00.673798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:00.674555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:00.681325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:00.681816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:00.682296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:00.682959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:00.683464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:00.683887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:00.698798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 HTTP/1.1 Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:03:00.700733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:03:00.707940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '2cbc6b6e-511f-4f80-8f1c-10fc819eb319'} Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:03:00.708859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:03:00.710420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:00.711782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:03:00.711782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6ca7cb7c-e054-4c0c-a49b-77271b6874e1 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 404 len: 111 microversion: 2.1 time: 0.034168 Aug 22 16:03:00.711782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 255/490] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:00 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:03:00.717072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a29ebd69-891c-4e1d-b5f2-be7e7df5e085 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '.version_select at 0x7fec9c260dc0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:00.739581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a29ebd69-891c-4e1d-b5f2-be7e7df5e085 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231912585" status: 202 len: 0 microversion: 2.1 time: 0.026216 Aug 22 16:03:00.740166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 236/491] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 22 16:03:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231912585 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:03:00.783831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:00.784622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:00.791572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:00.791989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:00.792498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:00.793339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:00.793867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:00.794362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:00.982526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:00.995609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6e84fe45-3101-441e-8ebc-322f12ac7260 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.217855 Aug 22 16:03:00.996016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 256/492] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:00 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:01.435375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2608a304-2a84-434d-ac2b-e0d4eb6efe69 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: .version_select at 0x7fec9c37cb80>, body: {"keypair": {"name": "tempest-keypair-1575826727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3PP20SMv194scTG0cvP9yJlUiJf/G3ph0p+0f9Hv9/tHUoG9Q4npsU1jCGxgpBLkhbrOY6CeHzXppa/9CtHkx7UsWsfelnJK56q52ZHlbzENM4F5iC0wMLh8Je+59dsg=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:01.452028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-2608a304-2a84-434d-ac2b-e0d4eb6efe69 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:03:01.456564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-2608a304-2a84-434d-ac2b-e0d4eb6efe69 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for user 1b896f9378dc4188868734e05ddd39fb and project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:03:01.477947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2608a304-2a84-434d-ac2b-e0d4eb6efe69 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047175 Aug 22 16:03:01.478570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 237/493] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:03:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:02.016637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:02.017657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:02.020767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:02.026177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:02.026673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:02.027233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:02.028116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:02.028578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:02.029011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:02.247513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:02.256159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-74a85126-d9f7-426c-bf39-b30588821eb7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.243425 Aug 22 16:03:02.256738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 257/494] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:02 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:03.033033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-392955425", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b541efda-15ea-4562-82cd-397beeb78e3b"}], "security_groups": [{"name": "tempest-securitygroup--602473517"}], "key_name": "tempest-keypair-1575826727", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:03.141468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] validate_networks() for [('b541efda-15ea-4562-82cd-397beeb78e3b', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:03:03.277924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:03.278641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:03.285187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:03.285781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:03.286295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:03.287105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:03.288004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:03.288512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:03.524617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:03.533514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6faf9c87-0d79-4016-8bdf-8d86b3720872 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.259430 Aug 22 16:03:03.547541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 258/495] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:03 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:03.595146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:03:03.595599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:03:03.596067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:03:03.596470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:03:03.596873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:03:03.605982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:03.606435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:03.606861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:03.607627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:03.608311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:03.608704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:03.625668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:03:03.629598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for user 1b896f9378dc4188868734e05ddd39fb and project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:03:03.641009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:03:03.643479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:03:03.690243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6d0b2d7d-fb4a-4fc3-8eba-77fbf6fc5d42 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.661999 Aug 22 16:03:03.690891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 238/496] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:03:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 16:03:03.701445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-35051fa0-30f9-4da5-bae5-9b7e9f28dede tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:03.702049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-35051fa0-30f9-4da5-bae5-9b7e9f28dede tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:03.769606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-35051fa0-30f9-4da5-bae5-9b7e9f28dede tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:03.783472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-35051fa0-30f9-4da5-bae5-9b7e9f28dede tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1241 microversion: 2.1 time: 0.082532 Aug 22 16:03:03.785014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 259/497] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:03 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:04.559657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:04.560275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:04.567533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:04.568114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:04.568560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:04.569243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:04.569692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:04.570114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:04.700882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:04.709556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5db82ad6-9208-4259-814e-486dc7a31ea5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.154350 Aug 22 16:03:04.710128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 239/498] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:04 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:04.805844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:04.806361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:04.813631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:04.814026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:04.814465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:04.815170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:04.815658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:04.816081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:04.884570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:04.892638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-42048707-4ca9-413e-be32-f3bd9a9c9315 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1237 microversion: 2.1 time: 0.090734 Aug 22 16:03:04.893212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 260/499] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:04 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:05.730216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:05.730935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:05.737367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:05.737851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:05.738295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:05.738995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:05.739484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:05.739905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:05.869140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:05.878021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-22985320-4a42-4197-b6e3-795579a41cbe tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.151751 Aug 22 16:03:05.878688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 240/500] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:05 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:05.915782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:05.916356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:05.922952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:05.923477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:05.923951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:05.925159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:05.925159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:05.925567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:05.990795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:05.998816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5640aecd-fe22-4548-9d90-feedd4c1c349 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1299 microversion: 2.1 time: 0.086946 Aug 22 16:03:05.999397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 261/501] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:05 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:06.698270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-c57ea973-6f9a-4771-a56c-fb997092b866 req-186d700c-80fe-4605-adeb-fdf5ad0123bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d63d81b-79b9-4a1a-9643-dcfd5866f65e", "tag": "c5f7712d-933b-4847-8a2e-de8191d67eb2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:06.709568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c57ea973-6f9a-4771-a56c-fb997092b866 req-186d700c-80fe-4605-adeb-fdf5ad0123bd service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:06.710036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c57ea973-6f9a-4771-a56c-fb997092b866 req-186d700c-80fe-4605-adeb-fdf5ad0123bd service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:06.710459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c57ea973-6f9a-4771-a56c-fb997092b866 req-186d700c-80fe-4605-adeb-fdf5ad0123bd service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:06.723068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-c57ea973-6f9a-4771-a56c-fb997092b866 req-186d700c-80fe-4605-adeb-fdf5ad0123bd service nova] Creating event network-changed:c5f7712d-933b-4847-8a2e-de8191d67eb2 for instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e on hv-cinder-85400 Aug 22 16:03:06.728699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-c57ea973-6f9a-4771-a56c-fb997092b866 req-186d700c-80fe-4605-adeb-fdf5ad0123bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034759 Aug 22 16:03:06.729543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 241/502] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:06.900078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:06.900684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:06.907638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:06.907792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:06.908169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:06.908861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:06.909315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:06.909732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:07.021504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:07.022287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:07.028924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:07.029414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:07.029847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:07.030715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:07.031212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:07.031677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:07.040600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:07.049281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4f1eded4-2cb2-47e0-88f2-4ec4bec83cfb tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.153056 Aug 22 16:03:07.050004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 262/503] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:06 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:07.165886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:07.173940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-db7fe394-ca5b-40a3-a1c4-70cee97bc53d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1366 microversion: 2.1 time: 0.156744 Aug 22 16:03:07.174781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 242/504] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:07 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:08.070006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:08.070640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:08.077068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:08.077545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:08.077976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:08.078654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:08.079104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:08.079547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:08.195549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:08.196174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:08.202633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:08.203658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:08.204154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:08.204861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:08.205318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:08.205748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:08.213716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:08.222643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8d64b0d4-b8b9-4af9-b7f5-a7315a11f331 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.156393 Aug 22 16:03:08.223373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 263/505] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:08 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:08.334416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:08.342022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-65f650aa-e5c4-4a58-8cfc-43dab8d827f3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1366 microversion: 2.1 time: 0.150488 Aug 22 16:03:08.342589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 243/506] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:08 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:09.243693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:09.244239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:09.250652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:09.251135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:09.251611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:09.252317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:09.252774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:09.253201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:09.363573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:09.364193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:09.370560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:09.371038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:09.371501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:09.372195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:09.372649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:09.373065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:09.394648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:09.402835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ee3ea356-fef3-43f0-8fd9-2a22f2a0018d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.163131 Aug 22 16:03:09.403411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 264/507] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:09 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:09.502706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:09.510390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-907d6fe6-1fa9-48ad-9444-d8390f010199 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1366 microversion: 2.1 time: 0.150684 Aug 22 16:03:09.510944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 244/508] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:09 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:10.424853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:10.425402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:10.431859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:10.432336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:10.432766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:10.433449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:10.433896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:10.434313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:10.532675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:10.533401 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:10.539897 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:10.540388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:10.541132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:10.541516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:10.541967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:10.542389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:10.570375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:10.579433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8dff81cd-f376-4104-a8ac-95aadb2a1c59 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.158606 Aug 22 16:03:10.579997 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 265/509] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:10 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:10.675681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:10.683414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-48ea63bb-2992-4025-84dd-c5f45e51bd2a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1366 microversion: 2.1 time: 0.155186 Aug 22 16:03:10.684067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 245/510] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:10 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:11.600671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:11.601282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:11.608433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:11.608923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:11.609358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:11.610717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:11.611171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:11.611642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:11.704249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:11.704853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:11.711760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:11.712234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:11.712661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:11.713365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:11.713795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:11.714408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:11.740781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:11.749116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f23a5af5-3f37-431b-a755-c871b17102d5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.152303 Aug 22 16:03:11.749684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 266/511] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:11 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:11.849442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:11.856961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-345626fb-2e2d-49bf-9f55-51978198dd00 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1366 microversion: 2.1 time: 0.156636 Aug 22 16:03:11.857529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 246/512] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:11 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:12.235185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-0128982d-1012-4bf8-a345-f7ba107b82cd req-00a0695b-8940-4fa2-a85b-5c2ae966c502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d63d81b-79b9-4a1a-9643-dcfd5866f65e", "name": "network-vif-plugged", "status": "completed", "tag": "c5f7712d-933b-4847-8a2e-de8191d67eb2"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:12.245503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-0128982d-1012-4bf8-a345-f7ba107b82cd req-00a0695b-8940-4fa2-a85b-5c2ae966c502 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:12.246361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-0128982d-1012-4bf8-a345-f7ba107b82cd req-00a0695b-8940-4fa2-a85b-5c2ae966c502 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:12.246815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-0128982d-1012-4bf8-a345-f7ba107b82cd req-00a0695b-8940-4fa2-a85b-5c2ae966c502 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:12.261283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-0128982d-1012-4bf8-a345-f7ba107b82cd req-00a0695b-8940-4fa2-a85b-5c2ae966c502 service nova] Creating event network-vif-plugged:c5f7712d-933b-4847-8a2e-de8191d67eb2 for instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e on hv-cinder-85400 Aug 22 16:03:12.267536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-0128982d-1012-4bf8-a345-f7ba107b82cd req-00a0695b-8940-4fa2-a85b-5c2ae966c502 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035880 Aug 22 16:03:12.268274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 267/513] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:12.770301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:12.770819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:12.779037 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:12.779573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:12.780012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:12.780722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:12.781169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:12.781587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:12.879684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:12.880402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:12.886478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:12.886958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:12.887425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:12.888111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:12.888557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:12.888975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:12.913274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:12.922173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-59b4403a-81d3-446c-8d3d-39077d688f03 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1734 microversion: 2.1 time: 0.155864 Aug 22 16:03:12.923291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 247/514] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:12 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:13.027198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:13.034756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0beb6fcf-4e2f-4d39-a14a-6062b03a1505 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1366 microversion: 2.1 time: 0.160395 Aug 22 16:03:13.035376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 268/515] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:12 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:13.944533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:13.945163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:13.947150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:13.947841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=10 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:13.954921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:13.955416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:13.955847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:13.956556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:13.957005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:13.957674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.055899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:14.056649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:14.058962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:14.066288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:14.066856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:14.067921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.068046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:14.068450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:14.068875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.089058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:14.097423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5a65c784-b9f7-41a7-bd57-c6725f143a8f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1714 microversion: 2.1 time: 0.156706 Aug 22 16:03:14.097995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 248/516] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:13 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:14.202284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:14.210271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:14.210492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4e033c9b-2d1b-4398-af1c-5052b114507d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1366 microversion: 2.1 time: 0.158538 Aug 22 16:03:14.210758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:14.211010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 269/517] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:14 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:14.216669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:14.217142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:14.217570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.218261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:14.218702 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:14.219117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.303965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] HTTP exception thrown: Cannot 'detach_volume' instance 9341c753-156a-4cf4-82d1-be8cbb188892 while it is in vm_state rescued Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Request method failure captured: Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments/82d4a78e-b44b-4480-9d1b-1e3a72c606f1 HTTP/1.1 Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fNthFCijBQYcUNtTBQSuBJ0oD9BJrnH3cIsim9NghrABLAj84RpI4-D9mE0jOusXI4P77OcTvIQq1TvMD_MA-JWKQnsgAHYUlVNj9F3B-vq-qKyZBS7BDg_WFHGVOGxLxfqMb5RAJ7mtPqIlONGfnCgnHBrSMipnDj0OwD8lwkro8 Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:03:14.305676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf2968f38ecf4e1aaf22dad09767c744", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}] Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 79dc62d7bb984157a117f79001a2ad68 Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:03:14.307188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Cannot 'detach_volume' instance 9341c753-156a-4cf4-82d1-be8cbb188892 while it is in vm_state rescued Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'server_id': '9341c753-156a-4cf4-82d1-be8cbb188892', 'id': '82d4a78e-b44b-4480-9d1b-1e3a72c606f1'} Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9341c753-156a-4cf4-82d1-be8cbb188892 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:03:14.307972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9341c753-156a-4cf4-82d1-be8cbb188892 while it is in vm_state rescued Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9341c753-156a-4cf4-82d1-be8cbb188892 while it is in vm_state rescued Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:03:14.309223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Returning 409 to user: Cannot 'detach_volume' instance 9341c753-156a-4cf4-82d1-be8cbb188892 while it is in vm_state rescued {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:03:14.310200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0ca3d5be-8f88-4392-b064-b7c8bcd71610 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments/82d4a78e-b44b-4480-9d1b-1e3a72c606f1" status: 409 len: 152 microversion: 2.1 time: 0.101441 Aug 22 16:03:14.310200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 249/518] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:03:14 2022] DELETE /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments/82d4a78e-b44b-4480-9d1b-1e3a72c606f1 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 22 16:03:14.318521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:14.319395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:14.326099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:14.326678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:14.327113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.327876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:14.328329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:14.328751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.396751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d362405a-ec4e-46b8-9403-5e4ce71a63d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "POST /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/action" status: 202 len: 0 microversion: 2.1 time: 0.083079 Aug 22 16:03:14.397424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 270/519] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:03:14 2022] POST /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 16:03:14.405926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:14.406537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:14.413372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:14.413854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:14.414281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.414962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:14.415434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:14.415855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:14.545911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:14.554588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8a72535e-e713-4bcb-9f49-cf2b8dfd19d0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1722 microversion: 2.1 time: 0.152470 Aug 22 16:03:14.555145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 250/520] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:14 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:15.233064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:15.233810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:15.240773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:15.241266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:15.241706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:15.242409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:15.242867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:15.243295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:15.247694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:15.378316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:15.386582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f3af5c3-d37f-47ca-a746-46e57408a77a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1557 microversion: 2.1 time: 0.158360 Aug 22 16:03:15.387144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 271/521] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:15 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:15.406544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:15.407620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:15.414101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:15.414585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:15.415020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:15.415738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:15.416219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:15.416646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:15.501113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bfa6fe00-514b-4105-84be-7ea03b1cbd8d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098387 Aug 22 16:03:15.501708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 251/522] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 22 16:03:15 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:03:15.575256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:15.575888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:15.583597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:15.584080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:15.584508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:15.585210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:15.585660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:15.586172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:15.867128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:15.875279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-806fe571-b9c3-4d4a-837a-9addde965731 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1722 microversion: 2.1 time: 0.303838 Aug 22 16:03:15.875919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 272/523] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:15 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:16.555828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-494d04f8-fb7a-43cc-8550-62fba6fd9f0c req-93ff0016-0612-4753-ac85-a2c5066d5976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d63d81b-79b9-4a1a-9643-dcfd5866f65e", "tag": "c5f7712d-933b-4847-8a2e-de8191d67eb2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:16.565950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-494d04f8-fb7a-43cc-8550-62fba6fd9f0c req-93ff0016-0612-4753-ac85-a2c5066d5976 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:16.566430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-494d04f8-fb7a-43cc-8550-62fba6fd9f0c req-93ff0016-0612-4753-ac85-a2c5066d5976 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:16.566865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-494d04f8-fb7a-43cc-8550-62fba6fd9f0c req-93ff0016-0612-4753-ac85-a2c5066d5976 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:16.577945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-494d04f8-fb7a-43cc-8550-62fba6fd9f0c req-93ff0016-0612-4753-ac85-a2c5066d5976 service nova] Creating event network-changed:c5f7712d-933b-4847-8a2e-de8191d67eb2 for instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e on hv-cinder-85400 Aug 22 16:03:16.583143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-494d04f8-fb7a-43cc-8550-62fba6fd9f0c req-93ff0016-0612-4753-ac85-a2c5066d5976 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031631 Aug 22 16:03:16.583848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 252/524] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:16.896504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:16.897035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:16.903607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:16.904095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:16.904538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:16.905245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:16.905699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:16.906127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:17.042672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:17.051112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-db776c78-3226-4b72-b132-d016081582f4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1722 microversion: 2.1 time: 0.158570 Aug 22 16:03:17.051801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 273/525] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:16 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:18.073536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:18.074338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:18.080930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:18.081363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:18.081789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:18.082724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:18.083167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:18.083612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:18.218602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:18.227417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0d969e68-6051-4207-b1e6-210a72a513d1 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1722 microversion: 2.1 time: 0.158498 Aug 22 16:03:18.227974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 253/526] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:18 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:19.248317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:19.248938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:19.255961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:19.256451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:19.256890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:19.257589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:19.258046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:19.258475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:19.395530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:19.404535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1c846b30-445c-413f-b234-6f3e3fd31657 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1728 microversion: 2.1 time: 0.159987 Aug 22 16:03:19.405120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 274/527] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:19 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:19.425936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:19.426558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:19.432887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:19.433358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:19.433789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:19.434472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:19.434917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:19.435353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:19.518595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57a20403-1ffe-4695-946e-6256e897f722 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097238 Aug 22 16:03:19.519179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 254/528] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 22 16:03:19 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:20.587698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-d24b509f-d363-4c73-a54a-d16a175b6041 req-314bc3de-8aa7-4a1b-be0e-6e1f3d670922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9341c753-156a-4cf4-82d1-be8cbb188892", "tag": "6251192b-4e4d-483e-bd56-34edb2edfa1c"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:20.597540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-d24b509f-d363-4c73-a54a-d16a175b6041 req-314bc3de-8aa7-4a1b-be0e-6e1f3d670922 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:20.598029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-d24b509f-d363-4c73-a54a-d16a175b6041 req-314bc3de-8aa7-4a1b-be0e-6e1f3d670922 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:20.598465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-d24b509f-d363-4c73-a54a-d16a175b6041 req-314bc3de-8aa7-4a1b-be0e-6e1f3d670922 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:20.613308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-d24b509f-d363-4c73-a54a-d16a175b6041 req-314bc3de-8aa7-4a1b-be0e-6e1f3d670922 service nova] Creating event network-changed:6251192b-4e4d-483e-bd56-34edb2edfa1c for instance 9341c753-156a-4cf4-82d1-be8cbb188892 on hv-cinder-85400 Aug 22 16:03:20.616659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-d24b509f-d363-4c73-a54a-d16a175b6041 req-314bc3de-8aa7-4a1b-be0e-6e1f3d670922 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032826 Aug 22 16:03:20.617612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 275/529] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:22.588601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:22.589118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:22.595059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:22.595575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:22.596013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:22.596698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:22.597147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:22.597569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:22.624864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:22.630070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9b173a92-1c7a-40cb-b9eb-189208254fbb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments/8bf690ac-7106-4a7f-9730-d39381f5a3cf" status: 200 len: 194 microversion: 2.20 time: 0.046043 Aug 22 16:03:22.630668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 255/530] 10.222.0.40 () {60 vars in 1454 bytes} [Mon Aug 22 16:03:22 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments/8bf690ac-7106-4a7f-9730-d39381f5a3cf => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 16:03:22.632584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-776aee10-38c8-47c2-93c9-8692934c83f5 req-68593e51-35c3-4887-a5bf-d7a6581007c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9341c753-156a-4cf4-82d1-be8cbb188892", "tag": "6251192b-4e4d-483e-bd56-34edb2edfa1c"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:22.642626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-776aee10-38c8-47c2-93c9-8692934c83f5 req-68593e51-35c3-4887-a5bf-d7a6581007c8 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:22.643207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-776aee10-38c8-47c2-93c9-8692934c83f5 req-68593e51-35c3-4887-a5bf-d7a6581007c8 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:22.643551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-776aee10-38c8-47c2-93c9-8692934c83f5 req-68593e51-35c3-4887-a5bf-d7a6581007c8 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:22.654415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-776aee10-38c8-47c2-93c9-8692934c83f5 req-68593e51-35c3-4887-a5bf-d7a6581007c8 service nova] Creating event network-changed:6251192b-4e4d-483e-bd56-34edb2edfa1c for instance 9341c753-156a-4cf4-82d1-be8cbb188892 on hv-cinder-85400 Aug 22 16:03:22.659401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-776aee10-38c8-47c2-93c9-8692934c83f5 req-68593e51-35c3-4887-a5bf-d7a6581007c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030731 Aug 22 16:03:22.660214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 276/531] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:22.698878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:22.699379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:22.705679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:22.706157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:22.706586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:22.707578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:22.708023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:22.708441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:22.789694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lazy-loading 'services' on Instance uuid 31a6012e-3710-4ea5-9cfa-7e0e34321caf {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:03:22.867936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-80d03a55-4e12-436b-a1b3-0ed41e94c02c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments/8bf690ac-7106-4a7f-9730-d39381f5a3cf" status: 202 len: 0 microversion: 2.20 time: 0.172715 Aug 22 16:03:22.868462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 256/532] 10.222.0.40 () {60 vars in 1457 bytes} [Mon Aug 22 16:03:22 2022] DELETE /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments/8bf690ac-7106-4a7f-9730-d39381f5a3cf => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:03:22.877514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:22.879974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:22.888142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:22.888598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:22.889348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:22.890062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:22.890522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:22.891029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:22.939712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ed3d9ab0-4a82-4ba5-954b-54b07b51729b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066253 Aug 22 16:03:22.940884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 277/533] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 22 16:03:22 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 16:03:23.956134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:23.958777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:23.965671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:23.966161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:23.966597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:23.967305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:23.967789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:23.968211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:23.998190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ab33b1a4-8f96-4ed5-b967-37bdfe911684 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047211 Aug 22 16:03:23.998661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 257/534] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 22 16:03:23 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:24.070687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:24.071259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:24.077709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:24.078188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:24.078657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:24.079367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:24.079830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:24.080256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:24.105003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:03:24.182914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-743b95f7-f4e2-40ee-92ce-0efd99aefb23 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 204 len: 0 microversion: 2.20 time: 0.115731 Aug 22 16:03:24.183670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 278/535] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Aug 22 16:03:24 2022] DELETE /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 16:03:24.192212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:24.192824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:24.198860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:24.199353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:24.199886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:24.200581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:24.201033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:24.201457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:24.337063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:24.345372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:24.346881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:24.348059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c6396599-fbfe-47bc-9c41-71974da3edec tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.159770 Aug 22 16:03:24.348615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 258/536] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:24 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:25.371375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:25.372077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:25.378657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:25.379143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:25.379613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:25.380315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:25.380777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:25.381206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:25.519503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:25.527640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:25.529149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:25.530322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-309bfc99-514c-4e66-b9df-e0f8a95438fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.163298 Aug 22 16:03:25.530876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 279/537] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:25 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:26.555270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:26.556134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:26.562618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:26.563729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:26.564169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:26.564872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:26.565360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:26.565791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:26.697359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:26.707881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:26.709406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:26.710575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4dd0d5ad-46b9-4a2a-a7eb-b18546bf340b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1724 microversion: 2.20 time: 0.160120 Aug 22 16:03:26.711364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 259/538] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:26 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:27.067106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-3165e54a-beee-44d3-a0de-ee825bccf16e req-c56037e1-cca7-4bce-b12c-dafb356d35a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6012e-3710-4ea5-9cfa-7e0e34321caf", "name": "network-vif-deleted", "tag": "f9c81dc7-a34c-438c-8a49-f74d23ef8f2f"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:27.079551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-3165e54a-beee-44d3-a0de-ee825bccf16e req-c56037e1-cca7-4bce-b12c-dafb356d35a6 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:27.080073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-3165e54a-beee-44d3-a0de-ee825bccf16e req-c56037e1-cca7-4bce-b12c-dafb356d35a6 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:27.080506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-3165e54a-beee-44d3-a0de-ee825bccf16e req-c56037e1-cca7-4bce-b12c-dafb356d35a6 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:27.093566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-3165e54a-beee-44d3-a0de-ee825bccf16e req-c56037e1-cca7-4bce-b12c-dafb356d35a6 service nova] Creating event network-vif-deleted:f9c81dc7-a34c-438c-8a49-f74d23ef8f2f for instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf on hv-cinder-85400 Aug 22 16:03:27.099598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-3165e54a-beee-44d3-a0de-ee825bccf16e req-c56037e1-cca7-4bce-b12c-dafb356d35a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036132 Aug 22 16:03:27.100848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 280/539] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:27.735165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:27.736424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:27.740789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:27.745153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:27.745803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:27.746385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:27.747138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:27.747896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:27.748409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:27.789312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:27.790127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:27.790709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:27.791430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lazy-loading 'fault' on Instance uuid 31a6012e-3710-4ea5-9cfa-7e0e34321caf {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:03:27.835407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:27.843107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:27.845270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:27.846447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-72aab485-abc7-417f-9bcc-c697a8b8a90a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 200 len: 1371 microversion: 2.20 time: 0.116032 Aug 22 16:03:27.847017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 260/540] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:27 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:28.870086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:28.870784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:28.878377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:28.878862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:28.879299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:28.880037 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:28.880491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:28.880919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:28.897193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] HTTP exception thrown: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Request method failure captured: Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf HTTP/1.1 Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fPv1RE8Zt4UfsztciHEEkDGdZxIbXMwtjJxxF7e0XvKyfHOV0--TwA1pQNR32RZ_el0i40Ia3P26hw-J32ra397cUZMLVOcYsUK6sXEn_C-kMtHLAwhPOyD1Us6BB-2u9CvRXS3vOj5IkZTmDEKPZqT-NlDmxQnaBF4IYl9vVZ5Lg Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:03:28.898865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5d8f1eeb5f85409eb243790c361f247a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}] Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: c71533864af94653be067b61e1c83789 Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:03:28.900603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '31a6012e-3710-4ea5-9cfa-7e0e34321caf'} Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:03:28.901766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:03:28.903205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:03:28.904617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Returning 404 to user: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:03:28.904617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cd62e580-3610-4c83-ad78-85798ca84e15 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 404 len: 111 microversion: 2.20 time: 0.034934 Aug 22 16:03:28.904617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 281/541] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:28 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:03:28.911251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5c017854-8185-4216-9e82-342b4e49056d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '.version_select at 0x7fec9c260c10>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:28.930724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5c017854-8185-4216-9e82-342b4e49056d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694654183" status: 204 len: 0 microversion: 2.20 time: 0.025001 Aug 22 16:03:28.931285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 261/542] 10.222.0.40 () {60 vars in 1262 bytes} [Mon Aug 22 16:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694654183 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 16:03:29.524852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0da18260-4492-4e9c-8120-ed704085ad59 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'create', calling method: .version_select at 0x7fec9c28c4c0>, body: {"keypair": {"name": "tempest-keypair-878913686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfG7S4IxCNxRqAqROCzEfJfdQb40SlwRPT5EyXt6LtS5hTqFyoLGCc8GdtFC7/E/bMY1bqcQhHmo+PZDIT5Hwl9PiqQmbZZQ9IPPEx8SqfOFT1O1qNwjfDBQcQRDgrskw=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:29.540802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-0da18260-4492-4e9c-8120-ed704085ad59 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Getting quotas for project 5d8f1eeb5f85409eb243790c361f247a. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:03:29.544624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-0da18260-4492-4e9c-8120-ed704085ad59 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Getting quotas for user c71533864af94653be067b61e1c83789 and project 5d8f1eeb5f85409eb243790c361f247a. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:03:29.566078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0da18260-4492-4e9c-8120-ed704085ad59 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045068 Aug 22 16:03:29.566669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 282/543] 10.222.0.40 () {62 vars in 1200 bytes} [Mon Aug 22 16:03:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 16:03:30.838437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-605566891", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02210ee6-9d4f-4a7c-8f78-2c26d29214a0"}], "security_groups": [{"name": "tempest-securitygroup--2054229577"}], "key_name": "tempest-keypair-878913686", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:30.940257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] validate_networks() for [('02210ee6-9d4f-4a7c-8f78-2c26d29214a0', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:03:31.309845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:03:31.310268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:03:31.310743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:03:31.311183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:03:31.311619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:03:31.320903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:31.321386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:31.321822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:31.322551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:31.323006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:31.323471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:31.341102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Getting quotas for project 5d8f1eeb5f85409eb243790c361f247a. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:03:31.345121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Getting quotas for user c71533864af94653be067b61e1c83789 and project 5d8f1eeb5f85409eb243790c361f247a. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:03:31.356704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:03:31.358973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:03:31.406542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-871ba32e-4fde-4de0-9504-79f9eccbdebb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.572306 Aug 22 16:03:31.407096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 262/544] 10.222.0.40 () {62 vars in 1188 bytes} [Mon Aug 22 16:03:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 16:03:31.418508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1b25ce0d-de29-40d5-82de-75c0979f5bf6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:31.419177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1b25ce0d-de29-40d5-82de-75c0979f5bf6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:31.474564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1b25ce0d-de29-40d5-82de-75c0979f5bf6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:31.482949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1b25ce0d-de29-40d5-82de-75c0979f5bf6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:31.484569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1b25ce0d-de29-40d5-82de-75c0979f5bf6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:31.486176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1b25ce0d-de29-40d5-82de-75c0979f5bf6 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1280 microversion: 2.20 time: 0.071706 Aug 22 16:03:31.486776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 283/545] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:31 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:32.509843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:32.510757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:32.516858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:32.517348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:32.517852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:32.518584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:32.519070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:32.519491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:32.587536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:32.597958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:32.599765 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:32.600991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-474c5424-9c0f-4c0d-b0a3-ed315b852782 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1340 microversion: 2.20 time: 0.095554 Aug 22 16:03:32.601626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 263/546] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:32 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:03:33.624438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:33.625134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:33.627659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:33.633116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:33.633606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:33.634045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:33.634754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:33.635214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:33.635670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:33.777843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:33.787676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:33.789183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:33.790363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c38f002a-c5ee-4504-9a5b-c1188fcfdc2f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1406 microversion: 2.20 time: 0.169978 Aug 22 16:03:33.790864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 284/547] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:33 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:33.848529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-f2be0663-46cb-4250-97d5-82403c831ffe req-e6f7fdf8-94de-4c9b-89a8-e5c594071581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d1084c-7c3d-47e1-b746-a0a6c7cf03f0", "tag": "df382da6-9308-4a07-bf51-aa9988affd3b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:33.861612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f2be0663-46cb-4250-97d5-82403c831ffe req-e6f7fdf8-94de-4c9b-89a8-e5c594071581 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:33.862088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f2be0663-46cb-4250-97d5-82403c831ffe req-e6f7fdf8-94de-4c9b-89a8-e5c594071581 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:33.862970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f2be0663-46cb-4250-97d5-82403c831ffe req-e6f7fdf8-94de-4c9b-89a8-e5c594071581 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:33.876447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-f2be0663-46cb-4250-97d5-82403c831ffe req-e6f7fdf8-94de-4c9b-89a8-e5c594071581 service nova] Creating event network-changed:df382da6-9308-4a07-bf51-aa9988affd3b for instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 on hv-cinder-85400 Aug 22 16:03:33.881393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-f2be0663-46cb-4250-97d5-82403c831ffe req-e6f7fdf8-94de-4c9b-89a8-e5c594071581 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038236 Aug 22 16:03:33.881983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 264/548] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:33.939277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:33.939952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:33.946580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:33.947285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:33.947822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:33.948593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:33.949107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:33.949593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:34.078924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lazy-loading 'services' on Instance uuid 6a2a6980-8937-485c-b773-bdd5eb754ca7 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:03:34.192600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e69bda4-ae04-4c27-ad4d-b8e7ef0f390a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/os-volume_attachments/ad366b0c-3940-406b-b6e0-6ce0fd3ddea1" status: 202 len: 0 microversion: 2.1 time: 0.257151 Aug 22 16:03:34.193554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 285/549] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:03:33 2022] DELETE /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/os-volume_attachments/ad366b0c-3940-406b-b6e0-6ce0fd3ddea1 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 16:03:34.814804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:34.815688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:34.823090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:34.823744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:34.824242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:34.824984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:34.825472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:34.825938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:34.955886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:34.964395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:34.965900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:34.967004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dbeaa0d6-6880-439d-ae60-b67599b90719 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1406 microversion: 2.20 time: 0.157299 Aug 22 16:03:34.967716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 265/550] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:34 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:35.989565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:35.990275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:35.996826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:35.997352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:35.997795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:35.998543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:35.998999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:35.999479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:36.140809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:36.149847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:36.151455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:36.152574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-342561de-5fae-4819-8044-a6d3b585751a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1406 microversion: 2.20 time: 0.167771 Aug 22 16:03:36.153137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 286/551] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:35 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:36.372127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b4bd0505-279c-440f-b3a2-aa29f84a4421 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:36.378949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4bd0505-279c-440f-b3a2-aa29f84a4421 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:36.379837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4bd0505-279c-440f-b3a2-aa29f84a4421 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:36.380500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4bd0505-279c-440f-b3a2-aa29f84a4421 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:36.404972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b4bd0505-279c-440f-b3a2-aa29f84a4421 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Going to try to stop instance {{(pid=121080) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 16:03:36.451571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b4bd0505-279c-440f-b3a2-aa29f84a4421 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/action" status: 202 len: 0 microversion: 2.1 time: 0.082575 Aug 22 16:03:36.452052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 266/552] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:03:36 2022] POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:03:36.461105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:36.461817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:36.467715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:36.468181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:36.468624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:36.469408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:36.470078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:36.470499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:36.602769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:36.610985 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cf073703-e5e9-44df-8be2-2ea72bb0cbe9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.154082 Aug 22 16:03:36.611589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 287/553] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:36 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:37.175878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:37.176574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:37.182705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:37.183182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:37.183653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:37.184356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:37.184812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:37.185240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:37.315312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:37.323570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:37.325072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:37.326173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3da819a4-7a45-42d5-b730-dc049f9442ee tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1406 microversion: 2.20 time: 0.155265 Aug 22 16:03:37.326724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 267/554] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:37 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:03:37.632045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:37.632718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:37.639080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:37.639599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:37.640041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:37.640732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:37.641190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:37.641618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:37.777277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:37.785615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-da79b25b-cc97-46cc-87a1-a70081cafebc tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.157454 Aug 22 16:03:37.786179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 288/555] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:37 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:38.348673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:38.349289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:38.355635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:38.356117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:38.356553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:38.357243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:38.357694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:38.358116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:38.491630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:38.500065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:38.502148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:38.503356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-18c99409-4cdb-470a-86db-32c4528b3fef tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1406 microversion: 2.20 time: 0.158470 Aug 22 16:03:38.503867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 268/556] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:38 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:38.806929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:38.807510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:38.813972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:38.814451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:38.814885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:38.815610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:38.816070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:38.816497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:38.949226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:38.957693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e36dc8b7-9663-49f4-8fc9-611313650e5c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.154918 Aug 22 16:03:38.958273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 289/557] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:38 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:39.525734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:39.526341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:39.532775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:39.533254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:39.533688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:39.534384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:39.534835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:39.535255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:39.669467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:39.678098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:39.679602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:39.680700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fbedbea9-b0e2-4291-b123-5e8a39ad3d81 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1406 microversion: 2.20 time: 0.158892 Aug 22 16:03:39.682019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 269/558] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:39 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:39.979269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:39.979839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:39.986732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:39.987217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:39.987683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:39.988380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:39.988837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:39.989293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:39.993331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:40.119032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:40.126936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c1278422-e626-44b5-852b-21303379c2e5 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.151685 Aug 22 16:03:40.127531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 290/559] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:39 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:40.414827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-486b54a7-28b7-4d23-ab9d-d12e8168785c req-be69c8c5-05d7-4b92-92ef-768bd90ae729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d1084c-7c3d-47e1-b746-a0a6c7cf03f0", "name": "network-vif-plugged", "status": "completed", "tag": "df382da6-9308-4a07-bf51-aa9988affd3b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:40.425055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-486b54a7-28b7-4d23-ab9d-d12e8168785c req-be69c8c5-05d7-4b92-92ef-768bd90ae729 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:40.425649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-486b54a7-28b7-4d23-ab9d-d12e8168785c req-be69c8c5-05d7-4b92-92ef-768bd90ae729 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:40.426116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-486b54a7-28b7-4d23-ab9d-d12e8168785c req-be69c8c5-05d7-4b92-92ef-768bd90ae729 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:40.437245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-486b54a7-28b7-4d23-ab9d-d12e8168785c req-be69c8c5-05d7-4b92-92ef-768bd90ae729 service nova] Creating event network-vif-plugged:df382da6-9308-4a07-bf51-aa9988affd3b for instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 on hv-cinder-85400 Aug 22 16:03:40.442687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-486b54a7-28b7-4d23-ab9d-d12e8168785c req-be69c8c5-05d7-4b92-92ef-768bd90ae729 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031559 Aug 22 16:03:40.443275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 270/560] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:40.703780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:40.704909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:40.711363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:40.711861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:40.712311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:40.713041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:40.713477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:40.713895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:40.847613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:40.855778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:40.857279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:40.858378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-703e1dab-3cb5-428e-9c3e-c387e6a11817 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1406 microversion: 2.20 time: 0.158640 Aug 22 16:03:40.858937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 291/561] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:40 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:41.149434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:41.150134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:41.157307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:41.157818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:41.158294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:41.159173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:41.159695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:41.160120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:41.293084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:41.301739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-73f1a98b-c2a3-4d91-8aab-5ad7c19dd49a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.157111 Aug 22 16:03:41.302321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 271/562] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:41 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:41.880719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:41.881331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:41.883651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:41.889078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:41.889566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:41.890007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:41.890710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:41.891169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:41.892142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:42.024454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:42.033331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:42.034906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:42.036235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-04eaf9f0-bdbf-44ee-a5f7-af1fd900b266 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1406 microversion: 2.20 time: 0.159303 Aug 22 16:03:42.036872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 292/563] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:41 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:42.323615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:42.324225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:42.326198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:42.327049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:42.334157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:42.334644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:42.335079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:42.335837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:42.336295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:42.336723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:42.467271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:42.476452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3c61b67a-2203-45aa-953e-253893515cab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.156642 Aug 22 16:03:42.477079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 272/564] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:42 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:43.060204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:43.060835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:43.067552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:43.068043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:43.068478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:43.069177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:43.069634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:43.070060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:43.211392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:43.219611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:43.221103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:43.222242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f2785ce9-f9bc-4394-a30a-95c0ac8425c3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1598 microversion: 2.20 time: 0.166116 Aug 22 16:03:43.222784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 293/565] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:03:43 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:03:43.243797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:43.244290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:43.250229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:43.250711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:43.251755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:43.252445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:43.253019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:43.253426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:43.270012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:43.336170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4fcbb0b7-872f-4405-826d-a5773a9de9dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096294 Aug 22 16:03:43.336751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 273/566] 10.222.0.40 () {60 vars in 1316 bytes} [Mon Aug 22 16:03:43 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 16:03:43.497904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:43.498655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:43.505966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:43.506459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:43.506898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:43.507640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:43.508100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:43.508526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:43.773470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:43.781241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16d0a0e3-ccaa-48c9-bff7-087b715d9bed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.287119 Aug 22 16:03:43.781822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 294/567] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:43 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:44.327830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-6e5767dd-607c-4b1d-8e49-4772207843a1 req-850a687b-8ad5-40c7-a18b-50026a273895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d1084c-7c3d-47e1-b746-a0a6c7cf03f0", "tag": "df382da6-9308-4a07-bf51-aa9988affd3b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:44.341709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6e5767dd-607c-4b1d-8e49-4772207843a1 req-850a687b-8ad5-40c7-a18b-50026a273895 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:44.342359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6e5767dd-607c-4b1d-8e49-4772207843a1 req-850a687b-8ad5-40c7-a18b-50026a273895 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:44.343014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6e5767dd-607c-4b1d-8e49-4772207843a1 req-850a687b-8ad5-40c7-a18b-50026a273895 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:44.356492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-6e5767dd-607c-4b1d-8e49-4772207843a1 req-850a687b-8ad5-40c7-a18b-50026a273895 service nova] Creating event network-changed:df382da6-9308-4a07-bf51-aa9988affd3b for instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 on hv-cinder-85400 Aug 22 16:03:44.361597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-6e5767dd-607c-4b1d-8e49-4772207843a1 req-850a687b-8ad5-40c7-a18b-50026a273895 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037497 Aug 22 16:03:44.362209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 274/568] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:44.803097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:44.803654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:44.809985 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:44.810478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:44.810914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:44.811652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:44.812109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:44.812533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:44.950832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:44.961192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a47b5a08-6d92-413b-a5db-b99fe6f9b211 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.161890 Aug 22 16:03:44.962036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 295/569] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:44 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:45.984638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:45.985285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:45.991559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:45.992042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:45.992482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:45.993171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:45.993633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:45.994055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:46.121462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:46.129647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-065c13c5-8c44-4ff7-b988-4df024344032 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1676 microversion: 2.1 time: 0.149814 Aug 22 16:03:46.130219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 275/570] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:45 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:47.151295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:47.151929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:47.158698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:47.159207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:47.159676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:47.160400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:47.160852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:47.161278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:47.496405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:47.504936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-df8b7803-85d6-456d-aa1b-298c0f7a5107 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1653 microversion: 2.1 time: 0.357464 Aug 22 16:03:47.505511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 296/571] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:47 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1653 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:47.525039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2cb1ec15-561f-4a27-ba3b-2741864cce63 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:03:47.531242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb1ec15-561f-4a27-ba3b-2741864cce63 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:47.531758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb1ec15-561f-4a27-ba3b-2741864cce63 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:47.532712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb1ec15-561f-4a27-ba3b-2741864cce63 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:47.554997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2cb1ec15-561f-4a27-ba3b-2741864cce63 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Going to try to start instance {{(pid=121080) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 16:03:47.597177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2cb1ec15-561f-4a27-ba3b-2741864cce63 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/action" status: 202 len: 0 microversion: 2.1 time: 0.075942 Aug 22 16:03:47.597774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 276/572] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:03:47 2022] POST /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:03:47.606053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:47.606535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:47.613502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:47.613999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:47.614440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:47.615158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:47.615650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:47.616083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:47.759016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:47.768035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e217c7a9-8f4f-4f1a-85f5-e3f158b3e39a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1662 microversion: 2.1 time: 0.165832 Aug 22 16:03:47.768625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 297/573] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:47 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:03:48.790565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:48.791206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:48.797366 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:48.797849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:48.798286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:48.798975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:48.799466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:48.799889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:48.934154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:48.941894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c71da3e7-ff06-4200-9b13-4e4524af9202 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1662 microversion: 2.1 time: 0.156153 Aug 22 16:03:48.942469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 277/574] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:48 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:49.963588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:49.964206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:49.971176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:49.971703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:49.972120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:49.972807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:49.973261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:49.973686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:50.102661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:03:50.111105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-440510c8-2879-4670-b02b-bb5f5214e56c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1666 microversion: 2.1 time: 0.151421 Aug 22 16:03:50.111700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 298/575] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:03:49 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:03:58.548799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:58.549289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:58.551915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:58.557041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:58.557516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:58.557947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:58.558628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:58.559072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:58.559527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:58.750733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lazy-loading 'services' on Instance uuid 9341c753-156a-4cf4-82d1-be8cbb188892 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:03:58.822017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-253005ff-0c24-4635-a18f-70822e283fde tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments/82d4a78e-b44b-4480-9d1b-1e3a72c606f1" status: 202 len: 0 microversion: 2.1 time: 0.276955 Aug 22 16:03:58.822592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 278/576] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:03:58 2022] DELETE /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments/82d4a78e-b44b-4480-9d1b-1e3a72c606f1 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:03:58.831759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:58.834336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:58.841417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:58.841826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:58.842282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:58.842993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:58.843494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:58.843926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:58.874643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bf019b32-170f-4aed-a057-585ec825343c tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 22 16:03:58.875201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 299/577] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:03:58 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:59.888645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:59.890996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:59.897258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:59.897741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:59.898170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:59.898849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:59.899294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:59.899733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:59.930486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57806e07-a5d6-41d3-944d-4e13825e8d25 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046561 Aug 22 16:03:59.931165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 279/578] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:03:59 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:03:59.936990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:03:59.937473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:03:59.944459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:59.944938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:59.945370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:59.946057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:03:59.946513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:03:59.946936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:03:59.970021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3cd95cf2-625a-48e3-8181-f3abcf258918 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/ips" status: 200 len: 151 microversion: 2.1 time: 0.036919 Aug 22 16:03:59.970597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 300/579] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 16:03:59 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:04:00.942834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:00.944994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:00.951357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:00.951836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:00.952265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:00.952941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:00.953385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:00.953800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:00.982940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e236b433-2c36-4917-9612-bd622d568461 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044038 Aug 22 16:04:00.983508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 280/580] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:04:00 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 16:04:01.061254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:01.061804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:01.068716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:01.069203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:01.069640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:01.070333 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:01.070793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:01.071218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:01.098292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:04:01.173124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6a186aec-93ca-4841-8cbf-44d117a9ed1e tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 204 len: 0 microversion: 2.1 time: 0.115449 Aug 22 16:04:01.173945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 301/581] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:04:01 2022] DELETE /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:04:01.183066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:01.183725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:01.190175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:01.190648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:01.191075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:01.191987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:01.192438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:01.192910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:01.301538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a35dbb41-1cd8-41bd-bb63-71a60fe36d60"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:01.303987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:01.309925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:01.310417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:01.310851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:01.311582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:01.312038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:01.312463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:01.329303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:01.337953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dc4a81fb-1166-4334-b458-bbeaa0263611 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1688 microversion: 2.1 time: 0.159189 Aug 22 16:04:01.338529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 281/582] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:01 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:02.359310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:02.359935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:02.366844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:02.367346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:02.367791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:02.368484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:02.368970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:02.369399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:02.499658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:02.507548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d53c24ce-3ead-4b90-9435-adca162d6ff0 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1688 microversion: 2.1 time: 0.152070 Aug 22 16:04:02.508132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 282/583] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:02 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:03.528504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:03.529158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:03.536069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:03.536558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:03.536998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:03.537698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:03.538158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:03.538584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:03.667027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:03.674666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cd802c00-c0f8-434d-9d62-dc08a746ced6 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1688 microversion: 2.1 time: 0.150110 Aug 22 16:04:03.675227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 283/584] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:03 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:04.695910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:04.696621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:04.702790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:04.703258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:04.703716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:04.704409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:04.704852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:04.705267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:04.841114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:04.849262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-538570bd-5b33-43ce-a442-56ac23c6c430 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1688 microversion: 2.1 time: 0.157156 Aug 22 16:04:04.849826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 284/585] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:04 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:05.650326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1f9ad736-cdfd-48ee-ad8e-69ff78b9b441 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.352860 Aug 22 16:04:05.650945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 302/586] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:04:01 2022] POST /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments => generated 194 bytes in 4356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:04:05.870683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:05.871539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:05.880745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:05.881242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:05.881683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:05.882391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:05.883020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:05.884804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:06.020222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:06.027985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a7a77cf4-dd08-4dea-aab1-e7e135796bf8 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1688 microversion: 2.1 time: 0.161717 Aug 22 16:04:06.028554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 285/587] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:05 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:06.777954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-20e09ef0-2eaa-4e78-9610-afb71cf1fb89 req-9ce8ae5f-a257-46f9-ac47-55b52fbd1056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9341c753-156a-4cf4-82d1-be8cbb188892", "name": "network-vif-deleted", "tag": "6251192b-4e4d-483e-bd56-34edb2edfa1c"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:06.783539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:06.790884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-20e09ef0-2eaa-4e78-9610-afb71cf1fb89 req-9ce8ae5f-a257-46f9-ac47-55b52fbd1056 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:06.791392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-20e09ef0-2eaa-4e78-9610-afb71cf1fb89 req-9ce8ae5f-a257-46f9-ac47-55b52fbd1056 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:06.791825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-20e09ef0-2eaa-4e78-9610-afb71cf1fb89 req-9ce8ae5f-a257-46f9-ac47-55b52fbd1056 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:06.804204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-20e09ef0-2eaa-4e78-9610-afb71cf1fb89 req-9ce8ae5f-a257-46f9-ac47-55b52fbd1056 service nova] Creating event network-vif-deleted:6251192b-4e4d-483e-bd56-34edb2edfa1c for instance 9341c753-156a-4cf4-82d1-be8cbb188892 on hv-cinder-85400 Aug 22 16:04:06.809196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-20e09ef0-2eaa-4e78-9610-afb71cf1fb89 req-9ce8ae5f-a257-46f9-ac47-55b52fbd1056 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035731 Aug 22 16:04:06.812711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 303/588] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:07.051319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:07.051319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:07.058620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:07.059124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:07.059584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:07.060293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:07.060835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:07.061170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:07.092632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:07.093112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:07.093544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:07.093989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lazy-loading 'fault' on Instance uuid 9341c753-156a-4cf4-82d1-be8cbb188892 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:04:07.139938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:07.147849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fc26e996-2a8c-4393-89ab-37264bdef203 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 200 len: 1334 microversion: 2.1 time: 0.101475 Aug 22 16:04:07.148421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 286/589] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:07 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:08.171318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:08.171965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 9341c753-156a-4cf4-82d1-be8cbb188892] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:08.178505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:08.178989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:08.179458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:08.180155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:08.180613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:08.181040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:08.194067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] HTTP exception thrown: Instance 9341c753-156a-4cf4-82d1-be8cbb188892 could not be found. Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Request method failure captured: Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 HTTP/1.1 Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fNthFCijBQYcUNtTBQSuBJ0oD9BJrnH3cIsim9NghrABLAj84RpI4-D9mE0jOusXI4P77OcTvIQq1TvMD_MA-JWKQnsgAHYUlVNj9F3B-vq-qKyZBS7BDg_WFHGVOGxLxfqMb5RAJ7mtPqIlONGfnCgnHBrSMipnDj0OwD8lwkro8 Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:04:08.195683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf2968f38ecf4e1aaf22dad09767c744", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}] Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 79dc62d7bb984157a117f79001a2ad68 Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 9341c753-156a-4cf4-82d1-be8cbb188892 could not be found. Aug 22 16:04:08.197244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '9341c753-156a-4cf4-82d1-be8cbb188892'} Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9341c753-156a-4cf4-82d1-be8cbb188892 could not be found. Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:04:08.198080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9341c753-156a-4cf4-82d1-be8cbb188892 could not be found. Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9341c753-156a-4cf4-82d1-be8cbb188892 could not be found. Aug 22 16:04:08.199578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:08.200893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Returning 404 to user: Instance 9341c753-156a-4cf4-82d1-be8cbb188892 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:04:08.200893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c161001b-f4df-4dd3-ae90-17125e71477b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892" status: 404 len: 111 microversion: 2.1 time: 0.030294 Aug 22 16:04:08.200893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 304/590] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:08 2022] GET /compute/v2.1/servers/9341c753-156a-4cf4-82d1-be8cbb188892 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:04:08.206426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c6640675-cb38-40d6-857a-e76fd59d902b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '.version_select at 0x7fec9c33caf0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:08.227389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c6640675-cb38-40d6-857a-e76fd59d902b tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-56630103" status: 202 len: 0 microversion: 2.1 time: 0.025208 Aug 22 16:04:08.227963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 287/591] 10.222.0.40 () {58 vars in 1215 bytes} [Mon Aug 22 16:04:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-56630103 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:04:11.096298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:11.096790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:11.103237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:11.103741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:11.104168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:11.104853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:11.105307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:11.105729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:11.108378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:11.133023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:04:11.209036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-575c13cf-a167-4328-b712-d3c8eaac9b1f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 204 len: 0 microversion: 2.1 time: 0.116727 Aug 22 16:04:11.209634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 305/592] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:04:11 2022] DELETE /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:04:11.218827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:11.219431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:11.227192 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:11.227730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:11.228166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:11.228872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:11.229328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:11.229757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:11.361928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:11.369536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-861d7055-d1b3-471d-86fc-593a4bb5f60f tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1506 microversion: 2.1 time: 0.155667 Aug 22 16:04:11.370102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 288/593] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:11 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:12.125360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:04:12.125917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:04:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:04:12.390610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:12.391316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:12.399067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:12.399592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:12.400033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:12.400728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:12.401186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:12.401613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:12.535852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:12.544012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-12e76fd6-953c-4aef-ae9e-2affb8fb3a38 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1506 microversion: 2.1 time: 0.157618 Aug 22 16:04:12.544576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 306/594] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:12 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:13.564460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:13.565072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:13.571510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:13.571990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:13.572425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:13.573116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:13.573567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:13.573991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:13.576678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:13.707500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:13.715089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eeaf8952-c53b-48bc-9006-a784382b79e2 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1506 microversion: 2.1 time: 0.154610 Aug 22 16:04:13.715677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 289/595] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:13 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:14.736594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:14.737134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:14.743672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:14.744157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:14.744591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:14.745284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:14.745737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:14.746160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:14.901545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:14.910121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-172080c0-70c8-45d1-984a-0cea7b83e763 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 200 len: 1506 microversion: 2.1 time: 0.177672 Aug 22 16:04:14.910690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 307/596] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:14 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:15.258425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-3e4556de-39d4-4891-aa22-a91e32576a25 req-9d3ca0df-2bdd-4a43-9750-913ad4e115c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d17721-4fcc-449b-af1c-c80802160428", "name": "network-vif-deleted", "tag": "be4edab1-bacb-43d0-8181-3d6691f0cef0"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:15.270747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3e4556de-39d4-4891-aa22-a91e32576a25 req-9d3ca0df-2bdd-4a43-9750-913ad4e115c0 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.271188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3e4556de-39d4-4891-aa22-a91e32576a25 req-9d3ca0df-2bdd-4a43-9750-913ad4e115c0 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.273342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3e4556de-39d4-4891-aa22-a91e32576a25 req-9d3ca0df-2bdd-4a43-9750-913ad4e115c0 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.286415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-3e4556de-39d4-4891-aa22-a91e32576a25 req-9d3ca0df-2bdd-4a43-9750-913ad4e115c0 service nova] Creating event network-vif-deleted:be4edab1-bacb-43d0-8181-3d6691f0cef0 for instance a9d17721-4fcc-449b-af1c-c80802160428 on hv-cinder-85400 Aug 22 16:04:15.291827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-3e4556de-39d4-4891-aa22-a91e32576a25 req-9d3ca0df-2bdd-4a43-9750-913ad4e115c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036626 Aug 22 16:04:15.292437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 290/597] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:15.347309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a35dbb41-1cd8-41bd-bb63-71a60fe36d60"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:15.350378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:15.357267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.357991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.358969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.359920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.360556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.361193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.442653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Invalid volume: volume a35dbb41-1cd8-41bd-bb63-71a60fe36d60 is already attached to instances: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments HTTP/1.1 Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 74 Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:04:15.444421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {"volumeAttachment": {"volumeId": "a35dbb41-1cd8-41bd-bb63-71a60fe36d60"}} Aug 22 16:04:15.446138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Invalid volume: volume a35dbb41-1cd8-41bd-bb63-71a60fe36d60 is already attached to instances: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '1d63d81b-79b9-4a1a-9643-dcfd5866f65e', 'body': {'volumeAttachment': {'volumeId': 'a35dbb41-1cd8-41bd-bb63-71a60fe36d60'}}} Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a35dbb41-1cd8-41bd-bb63-71a60fe36d60 is already attached to instances: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.447055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a35dbb41-1cd8-41bd-bb63-71a60fe36d60 is already attached to instances: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:15.448550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:15.450446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:15.450446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:04:15.450446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:04:15.450446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a35dbb41-1cd8-41bd-bb63-71a60fe36d60 is already attached to instances: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e Aug 22 16:04:15.450446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.450446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 400 to user: Invalid volume: volume a35dbb41-1cd8-41bd-bb63-71a60fe36d60 is already attached to instances: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:04:15.450446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2a74def2-64d1-4c95-821e-d9c688c2c4d2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103528 Aug 22 16:04:15.450446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 308/598] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:04:15 2022] POST /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:04:15.512657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:15.513226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:15.520854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.521266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.521700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.522386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.522832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.523246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.609230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lazy-loading 'services' on Instance uuid 1d63d81b-79b9-4a1a-9643-dcfd5866f65e {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:04:15.685506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d4d5ebb6-d324-4414-813e-7b12755de302 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments/a35dbb41-1cd8-41bd-bb63-71a60fe36d60" status: 202 len: 0 microversion: 2.1 time: 0.176888 Aug 22 16:04:15.686097 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 291/599] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:04:15 2022] DELETE /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments/a35dbb41-1cd8-41bd-bb63-71a60fe36d60 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:04:15.695560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:15.698087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:15.709953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.710807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.711638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.712882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.713732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.714483 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.749840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e16d232-8619-4265-a001-8c432e75e0b3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058652 Aug 22 16:04:15.750752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 309/600] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:04:15 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:15.931933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:15.932960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: a9d17721-4fcc-449b-af1c-c80802160428] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:15.940592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.941076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.942083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.943661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.944274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.944708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.959342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] HTTP exception thrown: Instance a9d17721-4fcc-449b-af1c-c80802160428 could not be found. Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Request method failure captured: Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 HTTP/1.1 Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fNthFCijBQYcUNtTBQSuBJ0oD9BJrnH3cIsim9NghrABLAj84RpI4-D9mE0jOusXI4P77OcTvIQq1TvMD_MA-JWKQnsgAHYUlVNj9F3B-vq-qKyZBS7BDg_WFHGVOGxLxfqMb5RAJ7mtPqIlONGfnCgnHBrSMipnDj0OwD8lwkro8 Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:04:15.960944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf2968f38ecf4e1aaf22dad09767c744", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}] Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 79dc62d7bb984157a117f79001a2ad68 Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance a9d17721-4fcc-449b-af1c-c80802160428 could not be found. Aug 22 16:04:15.962802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': 'a9d17721-4fcc-449b-af1c-c80802160428'} Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d17721-4fcc-449b-af1c-c80802160428 could not be found. Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:04:15.963884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d17721-4fcc-449b-af1c-c80802160428 could not be found. Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d17721-4fcc-449b-af1c-c80802160428 could not be found. Aug 22 16:04:15.965323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:15.966794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Returning 404 to user: Instance a9d17721-4fcc-449b-af1c-c80802160428 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:04:15.966794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f42dfac4-54ff-4ca4-83db-d2ebbe048801 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428" status: 404 len: 111 microversion: 2.1 time: 0.034832 Aug 22 16:04:15.966794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 292/601] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:15 2022] GET /compute/v2.1/servers/a9d17721-4fcc-449b-af1c-c80802160428 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:04:15.971911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:15.972409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:15.978454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.978932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.979408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:15.980099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:15.980550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:15.980974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:16.006641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:04:16.081277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8ca9b902-e4f1-454b-8d8b-708caa4b4d2d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "DELETE /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 204 len: 0 microversion: 2.1 time: 0.113628 Aug 22 16:04:16.082037 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 310/602] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:04:15 2022] DELETE /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:04:16.091193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:16.091837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:16.098318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:16.098796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:16.099234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:16.099953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:16.100408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:16.100833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:16.234920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:16.243750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f19a5f44-bdb1-4974-8f7f-c48d45cb2407 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.157108 Aug 22 16:04:16.244312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 293/603] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:16 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:16.767576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:16.769854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:16.776405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:16.776897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:16.777338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:16.778049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:16.778506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:16.779003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:16.811994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ff9eeea6-faae-4c3f-bed4-2df76a063c96 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049349 Aug 22 16:04:16.812560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 311/604] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:04:16 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:17.264586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:17.265143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:17.271242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:17.271751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:17.272182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:17.272867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:17.273316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:17.273739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:17.405480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:17.413143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-628fb0b2-08df-4f4f-a34e-0f01e43448c7 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.152535 Aug 22 16:04:17.413698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 294/605] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:17 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:17.825162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:17.827346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:17.833987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:17.834469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:17.834906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:17.835632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:17.836087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:17.836508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:17.866006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5d2bde17-afa1-4119-9a9e-179a06ce6257 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044829 Aug 22 16:04:17.866553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 312/606] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:04:17 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:18.434130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:18.434745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:18.441284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:18.441764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:18.442199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:18.442894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:18.443367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:18.443818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:18.575588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:18.583785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b87422ea-dfcb-4f36-a3d9-34b8f3daf42d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.153486 Aug 22 16:04:18.584352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 295/607] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:18 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:18.877924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:18.880104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:18.886540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:18.887028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:18.887505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:18.888205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:18.888662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:18.889091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:18.918749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e5adfd04-4eb0-4490-b51a-b93d087c3d45 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Aug 22 16:04:18.919304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 313/608] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:04:18 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:19.604823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:19.605497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:19.613138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:19.613754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:19.614375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:19.615076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:19.615559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:19.615982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:19.743499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:19.751060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9023d037-a38e-4c07-8fa2-4c56ce544cd4 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1520 microversion: 2.1 time: 0.150141 Aug 22 16:04:19.751710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 296/609] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:19 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:19.930444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:19.932720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:19.939092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:19.939638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:19.940069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:19.940751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:19.941200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:19.941617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:19.971230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-37ec4081-0ea7-4037-946a-7d88e23da9ff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Aug 22 16:04:19.971795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 314/610] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:04:19 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:20.772772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:20.774380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:20.781175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:20.781669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:20.782111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:20.783371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:20.783798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:20.784248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:20.803996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-914bffcf-c466-4c56-a6af-d5ae744a1540 req-2af329cd-09ac-4365-abc1-c4d2aec25a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e589fa-e174-4b10-a78f-dd18b10b90f5", "name": "network-vif-deleted", "tag": "3dd65d89-d95c-47fa-9299-3a65992872b8"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:20.813512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-914bffcf-c466-4c56-a6af-d5ae744a1540 req-2af329cd-09ac-4365-abc1-c4d2aec25a7c service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:20.814237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-914bffcf-c466-4c56-a6af-d5ae744a1540 req-2af329cd-09ac-4365-abc1-c4d2aec25a7c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:20.814811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-914bffcf-c466-4c56-a6af-d5ae744a1540 req-2af329cd-09ac-4365-abc1-c4d2aec25a7c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:20.828183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-914bffcf-c466-4c56-a6af-d5ae744a1540 req-2af329cd-09ac-4365-abc1-c4d2aec25a7c service nova] Creating event network-vif-deleted:3dd65d89-d95c-47fa-9299-3a65992872b8 for instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 on hv-cinder-85400 Aug 22 16:04:20.835074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-914bffcf-c466-4c56-a6af-d5ae744a1540 req-2af329cd-09ac-4365-abc1-c4d2aec25a7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034983 Aug 22 16:04:20.835744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 315/611] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:20.855577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:20.863809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-43e2e27d-49ff-4a2c-8d47-60989fcb57f5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1478 microversion: 2.1 time: 0.095574 Aug 22 16:04:20.864372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 297/612] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:20 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1478 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:20.985484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:20.987966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:20.994201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:20.994683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:20.995118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:20.995841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:20.996293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:20.996715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:21.025338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e4ca79cc-dd08-41af-b0a4-945c9b2def55 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045377 Aug 22 16:04:21.025810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 316/613] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:04:20 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 16:04:21.088737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:21.089241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:21.096117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:21.096606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:21.097044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:21.097752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:21.098211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:21.098633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:21.125289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:04:21.207064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-efcd6edd-a146-4189-8de1-d591ab446393 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 204 len: 0 microversion: 2.1 time: 0.121789 Aug 22 16:04:21.207642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 298/614] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:04:21 2022] DELETE /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:04:21.215666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:21.216278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:21.222905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:21.223407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:21.223849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:21.224533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:21.224987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:21.225406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:21.355279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:21.362931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-128494d3-6b77-4218-9cf5-4b360a0ff780 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1682 microversion: 2.1 time: 0.151093 Aug 22 16:04:21.363510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 317/615] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:21 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:21.885505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:21.886199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:21.892719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:21.893201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:21.893635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:21.894326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:21.894778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:21.895202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:21.927567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:21.928031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:21.928472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:21.928917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lazy-loading 'fault' on Instance uuid 91e589fa-e174-4b10-a78f-dd18b10b90f5 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:04:21.970638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:21.978316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8106dcf0-a54e-43b9-ab3a-6d3ea0f69c9d tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1310 microversion: 2.1 time: 0.097073 Aug 22 16:04:21.978877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 299/616] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:21 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:22.384743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:22.385384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:22.392378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:22.392860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:22.393294 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:22.393983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:22.394441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:22.394903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:22.527740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:22.536261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-54457783-fe88-40ff-8f71-0506be8ddb78 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1682 microversion: 2.1 time: 0.155322 Aug 22 16:04:22.536844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 318/617] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:22 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:22.999293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:22.999996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:23.007140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:23.007671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:23.008123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:23.008829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:23.009286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:23.009741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:23.041423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:23.041872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:23.042281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:23.042718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lazy-loading 'fault' on Instance uuid 91e589fa-e174-4b10-a78f-dd18b10b90f5 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:04:23.085498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dc62d7bb984157a117f79001a2ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2968f38ecf4e1aaf22dad09767c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:23.092386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-60bd69d5-42f4-447c-b0b3-a1a958fe7a85 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 200 len: 1310 microversion: 2.1 time: 0.097034 Aug 22 16:04:23.092928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 300/618] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:22 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:23.557799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:23.558463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:23.565068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:23.565549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:23.565982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:23.566673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:23.567123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:23.567564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:23.570476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:23.701378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:23.710873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b6f8db8f-e947-45fa-9770-41c27151808a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1682 microversion: 2.1 time: 0.157147 Aug 22 16:04:23.711807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 319/619] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:23 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:24.113519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:24.114321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] [instance: 91e589fa-e174-4b10-a78f-dd18b10b90f5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:24.120747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:24.121230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:24.121665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:24.122357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:24.122810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:24.123231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:24.137498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] HTTP exception thrown: Instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 could not be found. Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Request method failure captured: Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 HTTP/1.1 Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fNthFCijBQYcUNtTBQSuBJ0oD9BJrnH3cIsim9NghrABLAj84RpI4-D9mE0jOusXI4P77OcTvIQq1TvMD_MA-JWKQnsgAHYUlVNj9F3B-vq-qKyZBS7BDg_WFHGVOGxLxfqMb5RAJ7mtPqIlONGfnCgnHBrSMipnDj0OwD8lwkro8 Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:04:24.139137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf2968f38ecf4e1aaf22dad09767c744", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf2968f38ecf4e1aaf22dad09767c744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf2968f38ecf4e1aaf22dad09767c744"}]}] Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: cf2968f38ecf4e1aaf22dad09767c744 Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2038704959 Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 79dc62d7bb984157a117f79001a2ad68 Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2038704959-project Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 could not be found. Aug 22 16:04:24.141482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '91e589fa-e174-4b10-a78f-dd18b10b90f5'} Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 could not be found. Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:04:24.145440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 could not be found. Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 could not be found. Aug 22 16:04:24.146849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:24.148621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] Returning 404 to user: Instance 91e589fa-e174-4b10-a78f-dd18b10b90f5 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:04:24.148621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57f8d62c-5a40-4dd2-aa0b-8dda0f6769c5 tempest-ServerRescueNegativeTestJSON-2038704959 tempest-ServerRescueNegativeTestJSON-2038704959-project] 10.222.0.40 "GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5" status: 404 len: 111 microversion: 2.1 time: 0.031912 Aug 22 16:04:24.148621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 301/620] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:24 2022] GET /compute/v2.1/servers/91e589fa-e174-4b10-a78f-dd18b10b90f5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:04:24.242989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-2bbe2169-8e5d-4702-af2f-09ddcca946da req-8e586cfc-560f-46b9-b8cf-cae180e051a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d63d81b-79b9-4a1a-9643-dcfd5866f65e", "name": "network-vif-deleted", "tag": "c5f7712d-933b-4847-8a2e-de8191d67eb2"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:24.258682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-2bbe2169-8e5d-4702-af2f-09ddcca946da req-8e586cfc-560f-46b9-b8cf-cae180e051a0 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:24.259160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-2bbe2169-8e5d-4702-af2f-09ddcca946da req-8e586cfc-560f-46b9-b8cf-cae180e051a0 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:24.260659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-2bbe2169-8e5d-4702-af2f-09ddcca946da req-8e586cfc-560f-46b9-b8cf-cae180e051a0 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:24.274425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-2bbe2169-8e5d-4702-af2f-09ddcca946da req-8e586cfc-560f-46b9-b8cf-cae180e051a0 service nova] Creating event network-vif-deleted:c5f7712d-933b-4847-8a2e-de8191d67eb2 for instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e on hv-cinder-85400 Aug 22 16:04:24.281618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-2bbe2169-8e5d-4702-af2f-09ddcca946da req-8e586cfc-560f-46b9-b8cf-cae180e051a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042417 Aug 22 16:04:24.282633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 320/621] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:24.732227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:24.733211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:24.741171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:24.741919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:24.742605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:24.743582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:24.744115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:24.744789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:24.781697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:24.783099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:24.783641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:24.784315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lazy-loading 'fault' on Instance uuid 1d63d81b-79b9-4a1a-9643-dcfd5866f65e {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:04:24.819391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:24.820083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:24.827139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:24.827890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:24.828415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:24.829314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:24.829950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:24.830529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:24.834291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:24.844606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b999d732-0658-4866-b413-3afca5a8971f tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 200 len: 1331 microversion: 2.1 time: 0.116150 Aug 22 16:04:24.845648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 302/622] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:24 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:24.878471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:04:24.979984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-85e28fea-2a3a-4191-9436-ab65fd53612c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 204 len: 0 microversion: 2.1 time: 0.164927 Aug 22 16:04:24.991515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:24.992270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:24.995520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 321/623] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:04:24 2022] DELETE /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:04:24.999645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:25.000301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:25.000735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:25.001783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:25.002316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:25.002822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:25.225860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:25.233805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9586ad53-e96e-4e76-b523-ff0e3f726590 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1575 microversion: 2.1 time: 0.248015 Aug 22 16:04:25.234486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 303/624] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:24 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:25.865865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:25.866560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:25.873187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:25.873682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:25.874119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:25.874812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:25.875259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:25.876241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:25.889911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e HTTP/1.1 Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:04:25.892228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:04:25.893521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '1d63d81b-79b9-4a1a-9643-dcfd5866f65e'} Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:04:25.894285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:04:25.896104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:25.897463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:04:25.897463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-368cba6f-045d-44e2-95c0-3fc9e720d1a3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 404 len: 111 microversion: 2.1 time: 0.032048 Aug 22 16:04:25.897463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 322/625] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:25 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:04:25.902547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a458a04e-aa1c-4dfc-989d-c528c1508474 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '.version_select at 0x7fec9c3261f0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:25.921367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a458a04e-aa1c-4dfc-989d-c528c1508474 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575826727" status: 202 len: 0 microversion: 2.1 time: 0.022530 Aug 22 16:04:25.925064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 304/626] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Aug 22 16:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575826727 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:04:26.256039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:26.257031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:26.264340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:26.265753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:26.267837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:26.269711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:26.270410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:26.271142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:26.716561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:26.725381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9436a464-b24b-4029-933c-e9709b1cd4a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1575 microversion: 2.1 time: 0.473435 Aug 22 16:04:26.725960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 323/627] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:26 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1575 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:26.922066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ffb520a0-1ff1-4ad4-a2f1-10b4f21498d7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: .version_select at 0x7fec9c18be50>, body: {"keypair": {"name": "tempest-keypair-2146641828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWyyRA4F3c5ElFzaggRGXDbuuf052UkMaCgXoTeEv+FUFvuewaDYOqWh1HtF1vNso4pQVs+Hhanw6KCUu19X0r622a1gSH5E61FmObz2N5oMS+nwLc2K7ns+ulQibmJTQ=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:26.937607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-ffb520a0-1ff1-4ad4-a2f1-10b4f21498d7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:04:26.941984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-ffb520a0-1ff1-4ad4-a2f1-10b4f21498d7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for user 1b896f9378dc4188868734e05ddd39fb and project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:04:26.965540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ffb520a0-1ff1-4ad4-a2f1-10b4f21498d7 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047712 Aug 22 16:04:26.966327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 305/628] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:04:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:27.753977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:27.754924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:27.768658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:27.769558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:27.770395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:27.771353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:27.772173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:27.772817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:27.984217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:27.997822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1af7e92d-8dcb-41f3-a299-d4682a2f5dc3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1575 microversion: 2.1 time: 0.249136 Aug 22 16:04:27.998625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 324/629] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:27 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:28.123280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:28.124157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:28.137170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:28.138226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:28.139003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:28.140204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:28.141433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:28.142759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:28.189312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:28.208103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-79d3fd7d-8576-48c3-9de8-1f1c1c793f4f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/ips" status: 200 len: 152 microversion: 2.20 time: 0.203698 Aug 22 16:04:28.208901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 306/630] 10.222.0.40 () {60 vars in 1289 bytes} [Mon Aug 22 16:04:28 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/ips => generated 152 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 16:04:28.630690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-600907201", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b541efda-15ea-4562-82cd-397beeb78e3b"}], "security_groups": [{"name": "tempest-securitygroup--61922875"}], "key_name": "tempest-keypair-2146641828", "user_data": "}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:28.753730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] validate_networks() for [('b541efda-15ea-4562-82cd-397beeb78e3b', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:04:28.884767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-e7102999-0917-41ad-973e-98c8a889a3b8 req-fca6d591-bee4-4ca3-b7b5-507911d767e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b", "name": "network-vif-deleted", "tag": "1de14c98-3830-4ed5-8d8d-c98cefc71394"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:28.893066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:28.906297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e7102999-0917-41ad-973e-98c8a889a3b8 req-fca6d591-bee4-4ca3-b7b5-507911d767e5 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:28.907635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e7102999-0917-41ad-973e-98c8a889a3b8 req-fca6d591-bee4-4ca3-b7b5-507911d767e5 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:28.911713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e7102999-0917-41ad-973e-98c8a889a3b8 req-fca6d591-bee4-4ca3-b7b5-507911d767e5 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:28.934444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-e7102999-0917-41ad-973e-98c8a889a3b8 req-fca6d591-bee4-4ca3-b7b5-507911d767e5 service nova] Creating event network-vif-deleted:1de14c98-3830-4ed5-8d8d-c98cefc71394 for instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b on hv-cinder-85400 Aug 22 16:04:28.970701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-e7102999-0917-41ad-973e-98c8a889a3b8 req-fca6d591-bee4-4ca3-b7b5-507911d767e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089866 Aug 22 16:04:28.975182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 307/631] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:04:29.023604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:29.024906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:29.034568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:29.035556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:29.036304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:29.037474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:29.038312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:29.038984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:29.128012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:29.170079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-50b5b853-f17b-400f-a010-ab94aa515d14 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 200 len: 1224 microversion: 2.1 time: 0.150803 Aug 22 16:04:29.172810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 308/632] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:29 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 1224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:29.413339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:04:29.414009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:04:29.414568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:04:29.415264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:04:29.415868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:04:29.425959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:29.426543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:29.427156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:29.428025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:29.428670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:29.429156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:29.447746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:04:29.452562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Getting quotas for user 1b896f9378dc4188868734e05ddd39fb and project 4d570fd37c0043c3b572d6a228bd0ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:04:29.465257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:04:29.468027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:04:29.522486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-66b221dd-5ad8-450f-ac90-61adfda887fe tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.897155 Aug 22 16:04:29.523638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 325/633] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:04:28 2022] POST /compute/v2.1/servers => generated 400 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 16:04:29.534990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4c611575-deab-4135-aaed-4d13601a6993 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:29.535931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4c611575-deab-4135-aaed-4d13601a6993 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:29.608553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4c611575-deab-4135-aaed-4d13601a6993 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:29.617803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4c611575-deab-4135-aaed-4d13601a6993 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1241 microversion: 2.1 time: 0.086941 Aug 22 16:04:29.619204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 309/634] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:29 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:30.197443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:30.198077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:30.208776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:30.209030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:30.209855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:30.210744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:30.211723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:30.213771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:30.233651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] HTTP exception thrown: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Request method failure captured: Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b HTTP/1.1 Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6g8EEu6_-spRO1J6QV91c6iJjiaHYoSG-EJD8NCoiqcR11nIDDfCS7UETRKbzgt-MiAJktCKMAxNHDJD9cMLgsHTI4ETqd3dNRxyiJLKqya7wRsJJWdBgd2Y-FD4l0UpjVyF7t03WzvWj_ovVD0pxnMb6tsRSQNFwJcyfaCJm4uuj0 Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: cb5f34dcc6dd4d6c9f52af4cc142bb13 Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:04:30.235461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cb5f34dcc6dd4d6c9f52af4cc142bb13", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}] Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: cb5f34dcc6dd4d6c9f52af4cc142bb13 Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-TestVolumeBootPattern-1675342550-project Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: f50207197b8b46cea2ea40ca346bd8a0 Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-TestVolumeBootPattern-1675342550-project Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:04:30.236860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b'} Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:04:30.237720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:04:30.239835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:04:30.241134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Returning 404 to user: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:04:30.241134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ad7dcfd7-74ef-432f-ac82-59a14bbb96a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 404 len: 111 microversion: 2.1 time: 0.045913 Aug 22 16:04:30.241134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 326/635] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:30 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:04:30.339104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:30.339937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:30.347120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:30.347970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:30.348718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:30.349891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:30.349891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:30.350481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:30.383499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-388629542", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-579268431", "security_groups": [{"name": "tempest-secgroup-smoke-1751899005"}], "block_device_mapping_v2": [{"uuid": "a88ccabb-8c45-4739-af09-e1ed59ab67d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c654763e-5b64-4bcf-9232-fa5fc5f9ad5d"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:30.383777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lazy-loading 'flavor' on Instance uuid 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:04:30.511242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] validate_networks() for [('c654763e-5b64-4bcf-9232-fa5fc5f9ad5d', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:04:30.646935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a18f30cd-9c29-4994-b852-644ca86224aa tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/action" status: 202 len: 0 microversion: 2.20 time: 0.312681 Aug 22 16:04:30.647902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 310/636] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Aug 22 16:04:30 2022] POST /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 16:04:30.663245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:30.664403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:30.675109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:30.676100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:30.676641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:30.677300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:30.677881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:30.678186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:30.776069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:30.785030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2e4312b7-9e7d-4a23-a955-a1b1ac8062e2 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1293 microversion: 2.1 time: 0.128856 Aug 22 16:04:30.785788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 311/637] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:30 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1293 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:30.790327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:30.790934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:30.796853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:30.797560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:30.797999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:30.798696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:30.799151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:30.799663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:31.017954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:31.027290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:31.028838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:31.030004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-22195fde-3333-4653-a803-5f6faf9f08d9 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.243300 Aug 22 16:04:31.030998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 312/638] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:30 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:31.077756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:04:31.078386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:04:31.078988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:04:31.079442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:04:31.079900 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:04:31.089750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:31.090367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:31.091308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:31.093004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:31.093570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:31.094211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:31.112817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Getting quotas for project cb5f34dcc6dd4d6c9f52af4cc142bb13. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:04:31.116739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Getting quotas for user f50207197b8b46cea2ea40ca346bd8a0 and project cb5f34dcc6dd4d6c9f52af4cc142bb13. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:04:31.197506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:04:31.200171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a88ccabb-8c45-4739-af09-e1ed59ab67d8',volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:04:31.395640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-75b41be6-c63c-4a5f-9507-746cac58899a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.016080 Aug 22 16:04:31.399276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 327/639] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:04:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 16:04:31.413218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ceef62dc-1bec-4d3e-a274-fc11c9c15613 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:31.414884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ceef62dc-1bec-4d3e-a274-fc11c9c15613 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:31.474397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ceef62dc-1bec-4d3e-a274-fc11c9c15613 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:31.481674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ceef62dc-1bec-4d3e-a274-fc11c9c15613 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1093 microversion: 2.1 time: 0.072304 Aug 22 16:04:31.482546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 313/640] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:31 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:31.805633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:31.806272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:31.812213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:31.814803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:31.815296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:31.815977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:31.816713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:31.817173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:31.817795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:31.895221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:31.903068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0db54d2c-8cbc-498a-9851-5a2cc561545e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1299 microversion: 2.1 time: 0.101416 Aug 22 16:04:31.903691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 328/641] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:31 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:32.055789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:32.056781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:32.064791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:32.065289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:32.065935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:32.066644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:32.067101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:32.067563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:32.236312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:32.251819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:32.253322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:32.254762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-49689910-78f6-4df2-b343-1bd84d9272fc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.203208 Aug 22 16:04:32.255361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 314/642] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:32 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:32.508186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:32.508825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:32.515544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:32.516033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:32.516463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:32.517238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:32.517678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:32.518098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:32.586528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:32.596533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c106683f-9685-4245-b1c1-59ed2641fcbb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1191 microversion: 2.1 time: 0.096971 Aug 22 16:04:32.597416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 329/643] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:32 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:32.925907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:32.926962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:32.939738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:32.945070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:32.946588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:32.948626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:32.949946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:32.950889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.059535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:33.062556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:33.072711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.073640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.074226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.075864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.076331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.077507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.119555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7df4153c-e5bb-4994-b4cf-d6ea5376e349 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063949 Aug 22 16:04:33.120141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 330/644] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:04:33 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 16:04:33.137801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:33.148068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bd741ec3-9fd4-4609-a806-4f5e4df5995c tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1365 microversion: 2.1 time: 0.227248 Aug 22 16:04:33.148865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 315/645] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:32 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:33.189056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:33.189550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:33.195636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.196122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.196558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.197259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.197714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.198135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.228207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:04:33.344732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-81a74d4f-41ec-4154-9b75-879c35e3e6eb tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 204 len: 0 microversion: 2.1 time: 0.158901 Aug 22 16:04:33.345599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 331/646] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:04:33 2022] DELETE /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 16:04:33.351413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:33.352056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:33.358585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.359072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.359537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.360978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.361626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.362055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.409310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-874fea45-4015-4018-9c7e-add4f864cc0b req-45f1ec41-9515-4f74-80ae-c9688d521e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c028eac-791c-40aa-b4d4-249a7ca144c3", "tag": "119081dd-b841-49d3-95c6-a369dd4a5c49"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:33.420725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-874fea45-4015-4018-9c7e-add4f864cc0b req-45f1ec41-9515-4f74-80ae-c9688d521e43 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.421529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-874fea45-4015-4018-9c7e-add4f864cc0b req-45f1ec41-9515-4f74-80ae-c9688d521e43 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.421958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-874fea45-4015-4018-9c7e-add4f864cc0b req-45f1ec41-9515-4f74-80ae-c9688d521e43 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.434747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-874fea45-4015-4018-9c7e-add4f864cc0b req-45f1ec41-9515-4f74-80ae-c9688d521e43 service nova] Creating event network-changed:119081dd-b841-49d3-95c6-a369dd4a5c49 for instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 on hv-cinder-85400 Aug 22 16:04:33.439991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-874fea45-4015-4018-9c7e-add4f864cc0b req-45f1ec41-9515-4f74-80ae-c9688d521e43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234851 Aug 22 16:04:33.440836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 316/647] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:04:33.446555 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:33.447514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:33.454465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.455451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.455451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.457536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.457536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.457929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.566809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:33.581027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:33.585125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:33.586744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b0d16b87-6404-4040-8343-334f4a477748 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.239830 Aug 22 16:04:33.587728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 332/648] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:33 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:33.621764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:33.623234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:33.634014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.634875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.635676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.636913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:33.637320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:33.637728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:33.639399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:33.646571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e1118d12-b522-4abb-ab88-315ac5466a0b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1672 microversion: 2.1 time: 0.204259 Aug 22 16:04:33.647152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 317/649] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:33 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:33.727622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:33.735861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-87e39e97-4617-44db-8460-9dabea4825a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1209 microversion: 2.1 time: 0.120961 Aug 22 16:04:33.736587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 333/650] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:33 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:34.168814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:34.169379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:34.178103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:34.178601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:34.179058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:34.179871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:34.180422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:34.180853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:34.316342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:34.325487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4ed233a4-c280-476e-a468-065ebcfa8d87 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1365 microversion: 2.1 time: 0.160393 Aug 22 16:04:34.326392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 318/651] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:34 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:34.611494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:34.612207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:34.618778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:34.619265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:34.619726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:34.620434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:34.620885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:34.621340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:34.669965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:34.670573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:34.677867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:34.678424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:34.678857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:34.679597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:34.681242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:34.681242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:34.804489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:34.817291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:34.818815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:34.820120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16584858-e321-4fac-8630-41eab8cdcda1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.213400 Aug 22 16:04:34.820682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 334/652] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:34 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:34.832818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:34.833445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:34.839852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:34.840329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:34.840773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:34.841570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:34.842032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:34.842462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:34.850767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:34.858676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a6c13057-7383-4d6f-944a-e54d1f49e60e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1672 microversion: 2.1 time: 0.193835 Aug 22 16:04:34.859281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 319/653] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:34 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:34.978795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:34.981272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:34.988932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-717c069b-24dd-4992-aead-f9cc3f83995d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1277 microversion: 2.1 time: 0.167172 Aug 22 16:04:34.989897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 335/654] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:34 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:35.349459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:35.350875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:35.357444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:35.357949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:35.358391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:35.359104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:35.359588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:35.360578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:35.521182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:35.529370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7293a14b-4b78-4453-8a88-abff94ac08b0 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1365 microversion: 2.1 time: 0.185577 Aug 22 16:04:35.535959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 320/655] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:35 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:35.846507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:35.847108 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:35.854684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:35.868165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:35.869288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:35.870242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:35.871006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:35.871741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:35.881736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:35.882356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:35.893483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:35.893986 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:35.894427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:35.895170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:35.895626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:35.896053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:36.270743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:36.286990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:36.290284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:36.292820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e69ceee-31ce-477d-ad01-6c6ab4530d10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.450344 Aug 22 16:04:36.295612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 336/656] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:35 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:36.313064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:36.314516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:36.316323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:36.323376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-95cadba6-b8ca-4e61-9260-e688a788f910 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1672 microversion: 2.1 time: 0.445364 Aug 22 16:04:36.337658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:36.337658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:36.337658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:36.337989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 321/657] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:35 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1672 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:36.338077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:36.338077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:36.338077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:36.502521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-000dc1f4-1d62-4055-9d26-89a17c41dddf req-1b88b263-4942-4f7f-b5da-cc3c94888706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d19e272-2528-4d1f-b92b-34722e8821a9", "tag": "33f36485-abda-46f9-941b-aaee4f7dccc7"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:36.514207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-000dc1f4-1d62-4055-9d26-89a17c41dddf req-1b88b263-4942-4f7f-b5da-cc3c94888706 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:36.514850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-000dc1f4-1d62-4055-9d26-89a17c41dddf req-1b88b263-4942-4f7f-b5da-cc3c94888706 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:36.515418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-000dc1f4-1d62-4055-9d26-89a17c41dddf req-1b88b263-4942-4f7f-b5da-cc3c94888706 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:36.528097 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-000dc1f4-1d62-4055-9d26-89a17c41dddf req-1b88b263-4942-4f7f-b5da-cc3c94888706 service nova] Creating event network-changed:33f36485-abda-46f9-941b-aaee4f7dccc7 for instance 4d19e272-2528-4d1f-b92b-34722e8821a9 on hv-cinder-85400 Aug 22 16:04:36.534034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-000dc1f4-1d62-4055-9d26-89a17c41dddf req-1b88b263-4942-4f7f-b5da-cc3c94888706 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035137 Aug 22 16:04:36.535295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 322/658] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:04:36.560648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:36.561361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:36.568811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:36.569136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:36.569615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:36.570342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:36.570804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:36.571252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:36.871713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:36.880051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2abe8262-2b05-41f1-8884-e31eb4d30cc4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.582805 Aug 22 16:04:36.880650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 337/659] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:36 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:36.931082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:36.940027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a28889f5-341d-4e5f-a9c3-160bb9ebc465 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1365 microversion: 2.1 time: 0.392568 Aug 22 16:04:36.940786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 323/660] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:36 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:37.318535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:37.319263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:37.325499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.326917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.327582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:37.328536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.329676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.330444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:37.353529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:37.354602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:37.366976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.367815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.374779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:37.376595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.377258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.377946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:37.577402 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:37.598010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2ff5e4e8-78e5-4d95-95dd-00f002338133 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 200 len: 1605 microversion: 2.1 time: 0.248775 Aug 22 16:04:37.599291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 324/661] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:37 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 1605 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:37.615388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-0fb742f9-beeb-4d5c-b536-4d9c48bfe8b6 req-1412e220-f585-4227-8e20-162c660ff342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2a6980-8937-485c-b773-bdd5eb754ca7", "name": "network-vif-deleted", "tag": "4201889c-2b6f-405e-b57d-cdd19294861e"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:37.633221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0fb742f9-beeb-4d5c-b536-4d9c48bfe8b6 req-1412e220-f585-4227-8e20-162c660ff342 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.634058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0fb742f9-beeb-4d5c-b536-4d9c48bfe8b6 req-1412e220-f585-4227-8e20-162c660ff342 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.634743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0fb742f9-beeb-4d5c-b536-4d9c48bfe8b6 req-1412e220-f585-4227-8e20-162c660ff342 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:37.649028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-0fb742f9-beeb-4d5c-b536-4d9c48bfe8b6 req-1412e220-f585-4227-8e20-162c660ff342 service nova] Creating event network-vif-deleted:4201889c-2b6f-405e-b57d-cdd19294861e for instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 on hv-cinder-85400 Aug 22 16:04:37.656320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-0fb742f9-beeb-4d5c-b536-4d9c48bfe8b6 req-1412e220-f585-4227-8e20-162c660ff342 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055405 Aug 22 16:04:37.657510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 325/662] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:37.694049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:37.708853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:37.711669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:37.714905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-db3634c0-634a-459f-8a0f-87c96fda0b91 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.399961 Aug 22 16:04:37.729816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 338/663] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:37 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:37.902973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:37.903610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:37.910628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.911110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.911584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:37.912339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.912988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.913431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:37.918469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:37.962756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:37.963506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:37.977486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.977989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.978436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:37.979161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:37.979655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:37.980086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:38.147198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:38.159637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-14bcbfe9-895a-4cc4-9656-fe9a82062aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.260817 Aug 22 16:04:38.173720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 326/664] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:37 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:38.187660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:38.196650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0c8fc48a-ed82-4472-b71e-3a9d868a308e tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1365 microversion: 2.1 time: 0.238008 Aug 22 16:04:38.197243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 339/665] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:37 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:38.624904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:38.631518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:38.639749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:38.640243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:38.640673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:38.641963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:38.642412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:38.642830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:38.660369 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] HTTP exception thrown: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Request method failure captured: Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 HTTP/1.1 Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6g3HyjtXAS3kw76C26-uIODiaQElsXsDrqkjybN7UIh4_aCD-wauqAfzdHM9K9mJh6satjbdvYDtJZMv9IrrVW5FAR1hVE5-6FoO9dERwJII3B1UUHqJXvaHST3hkctSgxSosylnd6wF7MWMZmGv57hTZlZoJRc99ewLsECBNorka4 Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:04:38.662017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1440505c4e8e45918dcfaa217afe59bc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}] Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 244fd44e53dd4b1986abb6e4acba632b Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:04:38.663594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '6a2a6980-8937-485c-b773-bdd5eb754ca7'} Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:04:38.664517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:04:38.666081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:04:38.667360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Returning 404 to user: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:04:38.667360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d84d58ec-7360-4b8e-a90d-4a8e46569900 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 404 len: 111 microversion: 2.1 time: 0.043461 Aug 22 16:04:38.667360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 327/666] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:38 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 16:04:38.674046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e94e69b-667b-432f-99cc-e53b76cf8e53 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '.version_select at 0x7fec9c0ec790>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:38.706883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e94e69b-667b-432f-99cc-e53b76cf8e53 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420322041" status: 202 len: 0 microversion: 2.1 time: 0.037169 Aug 22 16:04:38.708320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 340/667] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 22 16:04:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420322041 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:04:38.741855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:38.742574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:38.748827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:38.749637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:38.750160 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:38.751946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:38.752496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:38.753112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:39.002784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:39.015626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:39.017762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:39.019213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8b560e58-7f78-47b5-b10d-099453d7b28c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.281731 Aug 22 16:04:39.019773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 328/668] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:38 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:39.181414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:39.181931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:39.188652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:39.189138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:39.189577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:39.190280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:39.190738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:39.191163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:39.220148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:39.221018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:39.238890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:39.239400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:39.239844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:39.251545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:39.252248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:39.253893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:39.390899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:39.401635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e3a27488-297c-4ef8-83f9-0548386429a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.224487 Aug 22 16:04:39.402760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 341/669] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:39 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:39.449088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:39.457620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b9403149-129d-4792-91c4-99e8325300f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1365 microversion: 2.1 time: 0.242463 Aug 22 16:04:39.458346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 329/670] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:39 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:39.572422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c7a64657-d473-497d-88bf-60286ad5bc72 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'create', calling method: .version_select at 0x7fec9c3654c0>, body: {"keypair": {"name": "tempest-keypair-930361147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe6UixACuO2Pyi0SBpLbMbkzb05evmna1jisA4/+IMDyzWOBaHnSbkC35tVS/nx6jR3UVFcir/c5XXITJ1nL6bkspDOgwyEIx4Skw1GQZDcKOKLSb0kp41tZFZLoCeyXw=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:39.588917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-c7a64657-d473-497d-88bf-60286ad5bc72 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Getting quotas for project 1440505c4e8e45918dcfaa217afe59bc. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:04:39.593122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-c7a64657-d473-497d-88bf-60286ad5bc72 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Getting quotas for user 244fd44e53dd4b1986abb6e4acba632b and project 1440505c4e8e45918dcfaa217afe59bc. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:04:39.617817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c7a64657-d473-497d-88bf-60286ad5bc72 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049243 Aug 22 16:04:39.618419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 342/671] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:04:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:40.046486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:40.047138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:40.054697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:40.055183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:40.055645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:40.056356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:40.056793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:40.057206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:40.207108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:40.218796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:40.220575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:40.221874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3082b75b-5eb3-4b94-8a0c-9b5a3eff9ed3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.179356 Aug 22 16:04:40.222423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 330/672] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:40 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:40.425362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:40.426827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:40.434883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:40.435480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:40.436486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:40.437311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:40.438488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:40.438980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:40.491773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:40.492772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:40.506226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:40.508119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:40.508868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:40.509746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:40.519995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:40.520783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:40.756002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:40.772620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:40.777296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d241ac7c-9543-464b-90b7-c5c1c0947596 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.357723 Aug 22 16:04:40.778469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 343/673] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:40 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:40.782921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-20862ed8-6b60-4085-8abc-4b6c94397dca tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1365 microversion: 2.1 time: 0.306921 Aug 22 16:04:40.784290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 331/674] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:40 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:40.889382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-f885174d-0a29-49fb-a5f8-a8a8cf49e3cb req-b8e6ebf6-d165-4a4f-8f90-5cc87b7c7281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c028eac-791c-40aa-b4d4-249a7ca144c3", "name": "network-vif-plugged", "status": "completed", "tag": "119081dd-b841-49d3-95c6-a369dd4a5c49"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:40.899083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-f885174d-0a29-49fb-a5f8-a8a8cf49e3cb req-b8e6ebf6-d165-4a4f-8f90-5cc87b7c7281 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:40.899631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-f885174d-0a29-49fb-a5f8-a8a8cf49e3cb req-b8e6ebf6-d165-4a4f-8f90-5cc87b7c7281 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:40.900410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-f885174d-0a29-49fb-a5f8-a8a8cf49e3cb req-b8e6ebf6-d165-4a4f-8f90-5cc87b7c7281 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:40.916935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-f885174d-0a29-49fb-a5f8-a8a8cf49e3cb req-b8e6ebf6-d165-4a4f-8f90-5cc87b7c7281 service nova] Creating event network-vif-plugged:119081dd-b841-49d3-95c6-a369dd4a5c49 for instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 on hv-cinder-85400 Aug 22 16:04:40.921842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-f885174d-0a29-49fb-a5f8-a8a8cf49e3cb req-b8e6ebf6-d165-4a4f-8f90-5cc87b7c7281 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036158 Aug 22 16:04:40.923614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 344/675] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:41.049517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-563505404", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50705536-805a-44d1-94d4-bf13bcaa804c"}], "security_groups": [{"name": "tempest-securitygroup--2047289857"}], "key_name": "tempest-keypair-930361147", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:41.165422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] validate_networks() for [('50705536-805a-44d1-94d4-bf13bcaa804c', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:04:41.249371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:41.250076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:41.252098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:41.257624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:41.258135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:41.258570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:41.259286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:41.259796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:41.260235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:41.430966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:41.439262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:41.440671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:41.441814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-379fa2d8-6bb7-4063-8bac-d08659d7830a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.196719 Aug 22 16:04:41.442569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 345/676] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:41 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:04:41.479358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=8 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:41.649300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:04:41.649743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:04:41.650245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:04:41.650645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:04:41.651048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:04:41.659796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:41.660276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:41.660700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:41.661414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:41.661857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:41.662272 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:41.679363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Getting quotas for project 1440505c4e8e45918dcfaa217afe59bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:04:41.683600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Getting quotas for user 244fd44e53dd4b1986abb6e4acba632b and project 1440505c4e8e45918dcfaa217afe59bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:04:41.694998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:04:41.697303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:04:41.743950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ae49d770-8567-4b54-89a5-eeaad0453d0a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.699227 Aug 22 16:04:41.744871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 332/677] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:04:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 16:04:41.756831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-10505882-8f2e-4597-b687-a2742062009e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:41.757523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-10505882-8f2e-4597-b687-a2742062009e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:41.802803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:41.803311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:41.809474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:41.810216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:41.810711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:41.811404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:41.812226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:41.812840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:41.836126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-10505882-8f2e-4597-b687-a2742062009e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:41.844751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-10505882-8f2e-4597-b687-a2742062009e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1236 microversion: 2.1 time: 0.091641 Aug 22 16:04:41.845838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 346/678] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:41 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1236 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:41.861024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:41.861882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:41.868596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:41.869394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:41.870068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:41.871089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:41.871744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:41.872334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:42.058806 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:42.070857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-720af620-91f2-465f-b208-89338fe14e9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.274161 Aug 22 16:04:42.072627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 333/679] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:41 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:42.104839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:42.115076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1717abce-ab11-49a2-bb86-e8e2ec23997d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1365 microversion: 2.1 time: 0.268015 Aug 22 16:04:42.116003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 347/680] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:41 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:42.465663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:42.466264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:42.473067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:42.473544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:42.473976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:42.474666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:42.475108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:42.475559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:42.611145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:42.621810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:42.623307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:42.624491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b593d775-4334-46d3-a8b3-557bbdf948a2 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.162778 Aug 22 16:04:42.625049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 334/681] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:42 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:42.865933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:42.866564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:42.873403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:42.873888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:42.874330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:42.875026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:42.875542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:42.875968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:42.939888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:42.946417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b76ee3b3-0fe9-45f4-98b4-0d0669132fd3 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1232 microversion: 2.1 time: 0.084275 Aug 22 16:04:42.946951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 348/682] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:42 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:43.108493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:43.109028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:43.115567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.116049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.116479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.117168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.117614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.118031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.137496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:43.138122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:43.144883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.145369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.145814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.146521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.146984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.147457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.341937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:43.345886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:43.354799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9bf28f2e-2329-4b3c-9954-ae5eb2a5f90f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.250164 Aug 22 16:04:43.355487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 335/683] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:43 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:43.367155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ac5c28a3-6833-4d05-93ab-7857b34608f5 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1556 microversion: 2.1 time: 0.233405 Aug 22 16:04:43.368733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 349/684] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:43 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:43.390556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:43.391780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:43.398287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.398780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.399217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.400233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.400692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.401121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.499124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cb439193-3821-422d-877b-b74e5e224b1d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113296 Aug 22 16:04:43.500009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 336/685] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 22 16:04:43 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:43.648359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:43.649104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:43.655262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.655918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.657124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.657762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.658292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.658792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.918530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:43.927546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:43.929183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:43.930370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e6003d1b-67b0-4d86-8cdd-40ff6c164197 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.286004 Aug 22 16:04:43.931256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 350/686] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:43 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:43.968925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:43.969538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:43.975898 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.976386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.976815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:43.978812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:43.979604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:43.980171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:44.084464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:44.097403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-177160b7-24b7-4efe-948c-70842f50e70f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1294 microversion: 2.1 time: 0.132340 Aug 22 16:04:44.111363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 337/687] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:43 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:44.384912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:44.385894 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:44.396257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:44.396824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:44.397347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:44.399687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:44.400378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:44.401073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:44.940919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:44.956105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b7f5f0b7-fcf0-4275-97c9-e4d13b08812b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.582983 Aug 22 16:04:44.967372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 351/688] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:44 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:44.967372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-e23d3eae-0724-4e35-9e2e-0a2b2a1ef7f6 req-52508829-657d-4b6e-9c22-fa37fa6a006c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c028eac-791c-40aa-b4d4-249a7ca144c3", "tag": "119081dd-b841-49d3-95c6-a369dd4a5c49"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:44.969317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:44.972576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:44.973890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e23d3eae-0724-4e35-9e2e-0a2b2a1ef7f6 req-52508829-657d-4b6e-9c22-fa37fa6a006c service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:44.974378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e23d3eae-0724-4e35-9e2e-0a2b2a1ef7f6 req-52508829-657d-4b6e-9c22-fa37fa6a006c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:44.974811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e23d3eae-0724-4e35-9e2e-0a2b2a1ef7f6 req-52508829-657d-4b6e-9c22-fa37fa6a006c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:44.981590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:44.982442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:44.983131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:44.985601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:44.986417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:44.987090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:44.988131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-e23d3eae-0724-4e35-9e2e-0a2b2a1ef7f6 req-52508829-657d-4b6e-9c22-fa37fa6a006c service nova] Creating event network-changed:119081dd-b841-49d3-95c6-a369dd4a5c49 for instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 on hv-cinder-85400 Aug 22 16:04:44.994173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-e23d3eae-0724-4e35-9e2e-0a2b2a1ef7f6 req-52508829-657d-4b6e-9c22-fa37fa6a006c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Aug 22 16:04:44.995086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 352/689] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:45.121659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:45.122500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:45.134214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:45.136221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:45.136777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:45.141746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:45.142468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:45.143681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:45.167084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:45.179885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:45.181968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:45.183716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9fbaeee6-576f-424d-82ee-12b65460b5e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.233290 Aug 22 16:04:45.184472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 338/690] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:44 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:04:45.297452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:45.308919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8bb625d4-40c6-4b9b-9059-4c6d13ee0708 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.191654 Aug 22 16:04:45.311379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 353/691] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:45 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:45.510486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-fb97d54f-4f90-479a-94dc-b9b52ee5f9f6 req-9ee86051-2735-40c8-81a4-f63b808eb500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948652d7-0fab-4122-b9e0-048548956aad", "tag": "af08d308-ed70-4a64-86ea-d9f76c5617af"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:45.522653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fb97d54f-4f90-479a-94dc-b9b52ee5f9f6 req-9ee86051-2735-40c8-81a4-f63b808eb500 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:45.523412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fb97d54f-4f90-479a-94dc-b9b52ee5f9f6 req-9ee86051-2735-40c8-81a4-f63b808eb500 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:45.524170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fb97d54f-4f90-479a-94dc-b9b52ee5f9f6 req-9ee86051-2735-40c8-81a4-f63b808eb500 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:45.538568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-fb97d54f-4f90-479a-94dc-b9b52ee5f9f6 req-9ee86051-2735-40c8-81a4-f63b808eb500 service nova] Creating event network-changed:af08d308-ed70-4a64-86ea-d9f76c5617af for instance 948652d7-0fab-4122-b9e0-048548956aad on hv-cinder-85400 Aug 22 16:04:45.543743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-fb97d54f-4f90-479a-94dc-b9b52ee5f9f6 req-9ee86051-2735-40c8-81a4-f63b808eb500 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036768 Aug 22 16:04:45.544345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 339/692] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:45.980303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:45.981537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:45.989976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:46.001344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:46.001344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:46.001344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:46.001344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:46.001743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:46.197018 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:46.209996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:46.210558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:46.213455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4f598e04-01e4-45ff-a1d9-ae843da30bbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.237030 Aug 22 16:04:46.226884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 354/693] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:45 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:46.227129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:46.227129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:46.227129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:46.227129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:46.227505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:46.227505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:46.330331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:46.330965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:46.344874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:46.345370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:46.345819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:46.346543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:46.347003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:46.347487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:46.380417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:46.390038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:46.393112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:46.394767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a39381b9-88a6-4576-a7fc-5929fad85bc8 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.190087 Aug 22 16:04:46.395479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 340/694] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:46 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:46.500385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:46.508449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-79d6f2cb-cdd8-4fa7-a9fd-3526561cc5b1 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.182194 Aug 22 16:04:46.509118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 355/695] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:46 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:47.234423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:47.235026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:47.241386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:47.242247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:47.242386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:47.243005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:47.243496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:47.243921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:47.418030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:47.418452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:47.419700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:47.431201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:47.432470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:47.433123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:47.434377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:47.435106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:47.435878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:47.439321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-79bae2a8-42c3-46d8-b2c1-dd2ec263846a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.207078 Aug 22 16:04:47.441502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 341/696] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:47 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:47.529992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:47.530602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:47.538987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:47.539777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:47.540395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:47.542022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:47.542864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:47.543777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:47.639809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:47.642564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:47.652583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:47.654177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:47.665692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3fd5e4af-8664-42b7-8f83-0a278406be4c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1744 microversion: 2.20 time: 0.251348 Aug 22 16:04:47.666685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 356/697] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:47 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1744 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:47.795525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:47.807202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-24a63624-1ed7-40cb-9e52-4bc47f86c0c8 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.280946 Aug 22 16:04:47.821101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 342/698] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:47 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:48.461910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:48.463066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:48.469842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:48.470378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:48.470764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:48.471498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:48.471957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:48.472385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:48.615104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:48.623100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4269babe-4f6e-4c13-996a-5366856cf78e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.165528 Aug 22 16:04:48.623703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 357/699] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:48 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:48.689129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:48.689856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:48.700347 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:48.701024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:48.701525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:48.702241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:48.702909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:48.703526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:48.831279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:48.832500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:48.840653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:48.841835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:48.842447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:48.844929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:48.845737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:48.846321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:48.870826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:48.879861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:48.881730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:48.883081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f63d720b-30de-45f7-b41a-c4b1fb642764 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1744 microversion: 2.20 time: 0.198940 Aug 22 16:04:48.895472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 343/700] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:48 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1744 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:04:49.009597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-504ac3ef-e2aa-41a1-84a2-0a901c4eb1c8 req-93ce522a-dc30-48e4-a734-d3d47b27aae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d19e272-2528-4d1f-b92b-34722e8821a9", "name": "network-vif-plugged", "status": "completed", "tag": "33f36485-abda-46f9-941b-aaee4f7dccc7"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:49.018004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:49.036409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5e943412-bf8a-4e22-a325-9331d60fcc47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.207533 Aug 22 16:04:49.037628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 358/701] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:48 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:49.039972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-504ac3ef-e2aa-41a1-84a2-0a901c4eb1c8 req-93ce522a-dc30-48e4-a734-d3d47b27aae8 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:49.040926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-504ac3ef-e2aa-41a1-84a2-0a901c4eb1c8 req-93ce522a-dc30-48e4-a734-d3d47b27aae8 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:49.041583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-504ac3ef-e2aa-41a1-84a2-0a901c4eb1c8 req-93ce522a-dc30-48e4-a734-d3d47b27aae8 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:49.057439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-504ac3ef-e2aa-41a1-84a2-0a901c4eb1c8 req-93ce522a-dc30-48e4-a734-d3d47b27aae8 service nova] Creating event network-vif-plugged:33f36485-abda-46f9-941b-aaee4f7dccc7 for instance 4d19e272-2528-4d1f-b92b-34722e8821a9 on hv-cinder-85400 Aug 22 16:04:49.063284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-504ac3ef-e2aa-41a1-84a2-0a901c4eb1c8 req-93ce522a-dc30-48e4-a734-d3d47b27aae8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063461 Aug 22 16:04:49.064201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 344/702] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:49.644432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:49.645080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:49.652115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:49.652598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:49.653131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:49.653746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:49.654202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:49.654625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:49.811867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:49.820345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-15ffc9df-8792-4a14-8731-3686caf52ab9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.180033 Aug 22 16:04:49.833836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 359/703] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:49 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:49.907092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:49.908484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:49.915298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:49.915816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:49.916252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:49.917085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:49.917722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:49.918298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:50.057314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:50.058065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:50.064244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:50.064822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:50.065332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:50.066111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:50.066648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:50.067182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:50.074151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:50.076522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:50.084536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:50.086313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:50.087690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c36ab45d-44c5-436b-a30b-dca8ddddac7c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.185372 Aug 22 16:04:50.088242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 345/704] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:49 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:50.220605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:50.230153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-49b9b2cd-76ad-4ecf-9ad3-c5854c87242b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.176687 Aug 22 16:04:50.230719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 360/705] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:50 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:04:50.841725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:50.842332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:50.849813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:50.850778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:50.851525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:50.852450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:50.853261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:50.853838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:51.096601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:51.114465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:51.115320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:51.116756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d7487abc-3955-497f-9cee-7d6e6ecf281f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1265 microversion: 2.1 time: 0.277300 Aug 22 16:04:51.116756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 346/706] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:50 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:51.146759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:51.147591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:51.149123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:51.151656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:51.154312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:51.157880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:51.162659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-9da85c9c-5b94-4c2b-a400-3fdabe39629d req-704d189e-97b2-4593-ab2a-5a75fcfd13cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d1084c-7c3d-47e1-b746-a0a6c7cf03f0", "name": "network-vif-plugged", "status": "completed", "tag": "df382da6-9308-4a07-bf51-aa9988affd3b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:51.172988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:51.193036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9da85c9c-5b94-4c2b-a400-3fdabe39629d req-704d189e-97b2-4593-ab2a-5a75fcfd13cc service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:51.194402 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9da85c9c-5b94-4c2b-a400-3fdabe39629d req-704d189e-97b2-4593-ab2a-5a75fcfd13cc service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:51.196458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9da85c9c-5b94-4c2b-a400-3fdabe39629d req-704d189e-97b2-4593-ab2a-5a75fcfd13cc service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:51.238261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-9da85c9c-5b94-4c2b-a400-3fdabe39629d req-704d189e-97b2-4593-ab2a-5a75fcfd13cc service nova] Creating event network-vif-plugged:df382da6-9308-4a07-bf51-aa9988affd3b for instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 on hv-cinder-85400 Aug 22 16:04:51.251661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-9da85c9c-5b94-4c2b-a400-3fdabe39629d req-704d189e-97b2-4593-ab2a-5a75fcfd13cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093650 Aug 22 16:04:51.255962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 347/707] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:04:51.262504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:51.263584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:51.271812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:51.272307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:51.273071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:51.273993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:51.274604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:51.275187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:51.463546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:51.478784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:51.487015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:51.489549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f359b23b-e65c-42cc-ab92-c3d98eea7080 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.380921 Aug 22 16:04:51.490787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 361/708] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:51 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:51.494961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:51.511447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a62f23fb-9fa7-4318-80f6-1ed0f4e1dc5b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.253824 Aug 22 16:04:51.512458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 348/709] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:51 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:52.138440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:52.139036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:52.145376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=18 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:52.148790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:52.149436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:52.149950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:52.150850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:52.151411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:52.152090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:52.362178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:52.372088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d0c66d29-a80c-4b5b-8bfa-be8fa274beca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1451 microversion: 2.1 time: 0.238057 Aug 22 16:04:52.373410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 362/710] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:52 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1451 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:52.397432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:52.398771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:52.402501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:52.403559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:52.413757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:52.415086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:52.415808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:52.416785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:52.417507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:52.418171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:52.514477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:52.514772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:52.526134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:52.526630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:52.527381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:52.528500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:52.529102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:52.529856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:52.679757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:52.692709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-87ed6ab9-0188-49db-bde5-0e3d79b53bf5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1451 microversion: 2.1 time: 0.300125 Aug 22 16:04:52.693473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 349/711] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:52 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1451 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:52.698000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:52.698613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:52.709651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:52.710146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:52.710587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:52.711837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:52.712304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:52.712733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:52.834138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:52.851883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:52.853709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:52.854972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3b48ed60-d975-4a7e-aed5-850554460743 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.345169 Aug 22 16:04:52.857503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 363/712] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:52 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:04:52.914004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:52.925828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-93c690cb-04bf-441a-8d71-64a149550d90 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.230464 Aug 22 16:04:52.927015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 350/713] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:52 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:53.305051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-63919a4e-9570-42ef-b2e8-5e9748de5bd1 req-7f15ec15-c504-4273-bb0a-975cc76e1f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948652d7-0fab-4122-b9e0-048548956aad", "name": "network-vif-plugged", "status": "completed", "tag": "af08d308-ed70-4a64-86ea-d9f76c5617af"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:53.316622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-63919a4e-9570-42ef-b2e8-5e9748de5bd1 req-7f15ec15-c504-4273-bb0a-975cc76e1f5b service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:53.317300 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-63919a4e-9570-42ef-b2e8-5e9748de5bd1 req-7f15ec15-c504-4273-bb0a-975cc76e1f5b service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:53.317719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-63919a4e-9570-42ef-b2e8-5e9748de5bd1 req-7f15ec15-c504-4273-bb0a-975cc76e1f5b service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:53.330621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-63919a4e-9570-42ef-b2e8-5e9748de5bd1 req-7f15ec15-c504-4273-bb0a-975cc76e1f5b service nova] Creating event network-vif-plugged:af08d308-ed70-4a64-86ea-d9f76c5617af for instance 948652d7-0fab-4122-b9e0-048548956aad on hv-cinder-85400 Aug 22 16:04:53.336422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-63919a4e-9570-42ef-b2e8-5e9748de5bd1 req-7f15ec15-c504-4273-bb0a-975cc76e1f5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035029 Aug 22 16:04:53.337562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 364/714] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:53.882163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:53.882972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:53.893435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:53.893884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:53.902135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:53.902909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:53.903510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:53.905317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:53.951548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:53.954513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:53.966132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:53.966627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:53.967103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:53.975496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:53.976001 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:53.976436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:54.236824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:54.247544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:54.256414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:54.262517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:54.269229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f87ae7b7-1ed2-42db-a08d-91c3372615a7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.323095 Aug 22 16:04:54.271298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 365/715] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:53 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:54.273150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ab98ee48-0603-4920-989d-806c005373d3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.394727 Aug 22 16:04:54.290038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 351/716] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:53 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:54.883521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-952277ab-2406-4e53-ac17-3037a2a512de req-a8b4e78f-5d44-4b5d-b329-2ffccf9277da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d19e272-2528-4d1f-b92b-34722e8821a9", "tag": "33f36485-abda-46f9-941b-aaee4f7dccc7"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:54.896450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-952277ab-2406-4e53-ac17-3037a2a512de req-a8b4e78f-5d44-4b5d-b329-2ffccf9277da service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:54.898063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-952277ab-2406-4e53-ac17-3037a2a512de req-a8b4e78f-5d44-4b5d-b329-2ffccf9277da service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:54.898762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-952277ab-2406-4e53-ac17-3037a2a512de req-a8b4e78f-5d44-4b5d-b329-2ffccf9277da service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:54.921199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-952277ab-2406-4e53-ac17-3037a2a512de req-a8b4e78f-5d44-4b5d-b329-2ffccf9277da service nova] Creating event network-changed:33f36485-abda-46f9-941b-aaee4f7dccc7 for instance 4d19e272-2528-4d1f-b92b-34722e8821a9 on hv-cinder-85400 Aug 22 16:04:54.940398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-952277ab-2406-4e53-ac17-3037a2a512de req-a8b4e78f-5d44-4b5d-b329-2ffccf9277da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061049 Aug 22 16:04:54.941639 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 366/717] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:55.296050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:55.297054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:55.303556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:55.306106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:55.307017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:55.307230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:55.308107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:55.309292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:55.309991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:55.310743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:55.326674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:55.328334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:55.328782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:55.329518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:55.329973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:55.330404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:55.633054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:55.643373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-219f989d-3a21-4585-b43d-6f80948c3e57 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1362 microversion: 2.1 time: 0.352678 Aug 22 16:04:55.652496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 352/718] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:55 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:55.675089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:55.685203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:55.687291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:55.688835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af8f3ece-aed2-46c3-9a87-0de9f953e367 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.394289 Aug 22 16:04:55.689921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 367/719] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:55 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:56.675814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:56.677611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:56.691061 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:56.693173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:56.693829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:56.694804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:56.695621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:56.696280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:56.713154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:56.713780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:56.727247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:56.743669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:56.744218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:56.745028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:56.745861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:56.746411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:56.750811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:57.001742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:57.005852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:57.014370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e238436d-e6ff-4e8f-87bf-018172a7c571 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1549 microversion: 2.1 time: 0.345313 Aug 22 16:04:57.018913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:57.020897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:57.022128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b68de985-3b0c-477a-98b4-6e6be6ea3c1c tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.313192 Aug 22 16:04:57.022686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 368/720] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:56 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:57.027926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 353/721] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:04:56 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1549 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:04:57.035295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:57.036197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:57.043036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:57.043771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:57.044366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:57.045357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:57.045973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:57.047083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:57.133167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a7c47cf7-0aa2-433f-b1ae-d9211926414e tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102032 Aug 22 16:04:57.133755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 369/722] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Aug 22 16:04:57 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:58.049355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:58.050136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:58.057080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:58.057809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:58.058432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:58.059664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:58.060335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:58.060950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:58.236235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:58.244981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:58.247026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:58.248636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ea5af8dd-6130-4f59-a047-9c767fa7b3eb tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.204224 Aug 22 16:04:58.249744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 354/723] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:58 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:04:58.641467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-ddc5d449-208a-45b1-8c56-e5cba18579fa req-c9e87359-d36a-4095-8406-17c5c6966283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948652d7-0fab-4122-b9e0-048548956aad", "tag": "af08d308-ed70-4a64-86ea-d9f76c5617af"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:04:58.664786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ddc5d449-208a-45b1-8c56-e5cba18579fa req-c9e87359-d36a-4095-8406-17c5c6966283 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:58.665830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ddc5d449-208a-45b1-8c56-e5cba18579fa req-c9e87359-d36a-4095-8406-17c5c6966283 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:58.666528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ddc5d449-208a-45b1-8c56-e5cba18579fa req-c9e87359-d36a-4095-8406-17c5c6966283 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:58.682793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-ddc5d449-208a-45b1-8c56-e5cba18579fa req-c9e87359-d36a-4095-8406-17c5c6966283 service nova] Creating event network-changed:af08d308-ed70-4a64-86ea-d9f76c5617af for instance 948652d7-0fab-4122-b9e0-048548956aad on hv-cinder-85400 Aug 22 16:04:58.691001 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-ddc5d449-208a-45b1-8c56-e5cba18579fa req-c9e87359-d36a-4095-8406-17c5c6966283 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054551 Aug 22 16:04:58.691882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 370/724] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:04:59.274072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:04:59.274772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:04:59.281873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:59.282605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:59.283196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:59.284123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:04:59.284733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:04:59.285309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:04:59.540054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:59.549386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:59.550905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:04:59.552136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c910743d-934f-4ede-80bc-97b3edb3bb10 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.281985 Aug 22 16:04:59.566487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 355/725] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:04:59 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:00.575670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:00.576375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:00.586770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:00.587124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:00.589014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:00.591800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:00.593346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:00.598059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:00.782625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:00.797242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:00.798955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:00.800699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b118ef07-cf63-420a-8250-16f0c7d2e74d tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.230032 Aug 22 16:05:00.801498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 371/726] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:00 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:05:01.824905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:01.825681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:01.834216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:01.840883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:01.841498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:01.842325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:01.842913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:01.843489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:01.999489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:02.009097 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:02.010599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:02.011796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d1ff9b14-88d8-4966-8a6c-7e76be62698b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1739 microversion: 2.20 time: 0.190790 Aug 22 16:05:02.012365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 356/727] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:01 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:03.034663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:03.035272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:03.041784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:03.042267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:03.042703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:03.043421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:03.043871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:03.044292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:03.189263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:03.197740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:03.199239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:03.200454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-63d47ef6-e4ab-4864-af67-294a1bcc4824 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1721 microversion: 2.20 time: 0.170331 Aug 22 16:05:03.201009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 372/728] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:03 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:04.225299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:04.225875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:04.232886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:04.233375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:04.234397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:04.235104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:04.235589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:04.236013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:04.411552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:04.420918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:04.422451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:04.423940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c93ee534-d1fd-4ac4-b3cb-2daf4e3210b4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1721 microversion: 2.20 time: 0.202728 Aug 22 16:05:04.424508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 357/729] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:04 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:05.447136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:05.447758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:05.454283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:05.454762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:05.455296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:05.455941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:05.456395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:05.457074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:05.608266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:05.617405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:05.618882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:05.620147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-20d121b2-2435-4b8c-b3e0-f0b7948b3b13 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1721 microversion: 2.20 time: 0.176984 Aug 22 16:05:05.620680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 373/730] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:05 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:06.644976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:06.645579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:06.652321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:06.652569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:06.652999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:06.653762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:06.654217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:06.654635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:06.795661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:06.804855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:06.806390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:06.807618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-db19ed51-aa8f-4f7e-9030-b31a2cbbf6d5 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1664 microversion: 2.20 time: 0.166894 Aug 22 16:05:06.808386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 358/731] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:06 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:06.832310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d730ff45-03ea-4ed5-a9ab-10922d0a534e"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:05:06.834643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:06.841726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:06.842265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:06.842687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:06.843455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:06.843919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:06.844343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:07.022496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:07.148351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-40c6a915-587d-41c2-8fac-3404a39b4809 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.320790 Aug 22 16:05:07.149723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 374/732] 10.222.0.40 () {62 vars in 1364 bytes} [Mon Aug 22 16:05:06 2022] POST /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 16:05:07.237191 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-30cd1105-c397-40c0-a2f0-b6f1cf36367f req-b7b714f2-fde3-49a0-a903-b8fe77ffc983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d1084c-7c3d-47e1-b746-a0a6c7cf03f0", "name": "network-vif-unplugged", "status": "completed", "tag": "df382da6-9308-4a07-bf51-aa9988affd3b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:05:07.246800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-30cd1105-c397-40c0-a2f0-b6f1cf36367f req-b7b714f2-fde3-49a0-a903-b8fe77ffc983 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:07.247276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-30cd1105-c397-40c0-a2f0-b6f1cf36367f req-b7b714f2-fde3-49a0-a903-b8fe77ffc983 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:07.247743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-30cd1105-c397-40c0-a2f0-b6f1cf36367f req-b7b714f2-fde3-49a0-a903-b8fe77ffc983 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:07.258514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.compute.server_external_events [req-30cd1105-c397-40c0-a2f0-b6f1cf36367f req-b7b714f2-fde3-49a0-a903-b8fe77ffc983 service nova] Unable to find a host for instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0. Dropping event network-vif-unplugged {{(pid=121080) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 16:05:07.259414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-30cd1105-c397-40c0-a2f0-b6f1cf36367f req-b7b714f2-fde3-49a0-a903-b8fe77ffc983 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.175963 Aug 22 16:05:07.260121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 359/733] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 177 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 22 16:05:07.274265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:07.274767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:07.282561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:07.283031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:07.283487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:07.284173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:07.284622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:07.285032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:09.871867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a6b5c837-93f7-4f0a-ab11-4b188e54af02 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/os-volume_attachments/d730ff45-03ea-4ed5-a9ab-10922d0a534e" status: 202 len: 0 microversion: 2.20 time: 2.601349 Aug 22 16:05:09.872552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 375/734] 10.222.0.40 () {60 vars in 1457 bytes} [Mon Aug 22 16:05:07 2022] DELETE /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/os-volume_attachments/d730ff45-03ea-4ed5-a9ab-10922d0a534e => generated 0 bytes in 2603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 16:05:09.932144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:05:09.932748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:09.939828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:09.940311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:09.940748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:09.941439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:09.941891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:09.942316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:09.971544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121080) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 16:05:10.036799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2b3a1e29-e900-4638-8b52-86631f05023a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "POST /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/action" status: 202 len: 0 microversion: 2.20 time: 0.108127 Aug 22 16:05:10.037511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 360/735] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Aug 22 16:05:09 2022] POST /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:05:10.046186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:10.048080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:10.053529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:10.054021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:10.054457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:10.055737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:10.055856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:10.056295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:10.195591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:10.204322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:10.205817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:10.207256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-894f14ad-c52e-4a28-bb5f-fa7e7dab2797 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1672 microversion: 2.20 time: 0.165148 Aug 22 16:05:10.207866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 376/736] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:10 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:11.230369 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:11.230974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:11.237938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:11.239188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:11.239757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:11.240743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:11.241230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:11.241656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:11.371814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:11.380123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:11.381643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:11.382793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3e854ccd-0528-493c-ad47-149dabb19656 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.156359 Aug 22 16:05:11.383372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 361/737] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:11 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:12.406519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:12.407127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:12.413606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:12.414082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:12.414528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:12.415201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:12.415686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:12.416110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:12.553010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:12.561091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:12.562591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:12.563760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-65cbc558-5e82-47d0-8ed5-a6754427bcd4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.161625 Aug 22 16:05:12.564313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 377/738] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:12 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:13.586277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:13.586952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:13.593377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:13.593973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:13.594423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:13.595250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:13.595754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:13.596027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:13.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:13.734678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:13.742558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:13.744093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:13.745247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-589ea49b-741b-4fb2-9e0f-b7ccb2330b57 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.162847 Aug 22 16:05:13.745803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 362/739] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:13 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:14.768884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:14.769511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:14.781992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:14.781992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:14.781992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:14.782447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:14.783563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:14.784595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:14.960250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:14.970562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:14.972116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:14.973499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5f08d4b7-bc22-4764-9188-15ae606da3dd tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.208962 Aug 22 16:05:14.974061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 378/740] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:14 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 16:05:15.997991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:16.003546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:16.005661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:16.006021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:16.006468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:16.007642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:16.007841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:16.008902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:16.164601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:16.174225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:16.175736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:16.176886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ea8ebd4a-40d6-45c7-abea-e0bb4cfcbe86 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.183609 Aug 22 16:05:16.177475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 363/741] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:15 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:17.199964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:17.200581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:17.207279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:17.207794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:17.208233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:17.208948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:17.209406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:17.209827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:17.349529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:17.360837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:17.362526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:17.363824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-07e49460-619e-423a-afa4-fec1c063f3e0 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.167767 Aug 22 16:05:17.364462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 379/742] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:17 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:18.387063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:18.387685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:18.394334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:18.394805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:18.395231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:18.395971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:18.396422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:18.396838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:18.542766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:18.552498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:18.553999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:18.555160 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e41305ba-19ff-461a-8f2a-16e69c75cf1f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.171964 Aug 22 16:05:18.555758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 364/743] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:18 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:19.579189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:19.579866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:19.586740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:19.587253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:19.587746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:19.588459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:19.588923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:19.589351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:19.728781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:19.738556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:19.740098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:19.741364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-392e26c0-e795-4dbb-82ed-b6e8cfd60480 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.166664 Aug 22 16:05:19.741878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 380/744] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:19 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:20.764904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:20.766944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:20.774005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:20.774548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:20.775100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:20.775882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:20.776373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:20.776852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:20.932301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:20.941256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:20.942654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:20.943848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8efe4a06-ec98-43fa-b431-8beda55ec25b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.183072 Aug 22 16:05:20.944405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 365/745] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:20 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:21.966245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:21.966903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:21.973271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:21.973741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:21.974204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:21.974859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:21.975308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:21.975787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:22.116749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:22.129110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:22.130834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:22.132057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-be40b320-4e80-4bbc-a362-5bd92d535aa4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.169853 Aug 22 16:05:22.132638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 381/746] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:21 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:23.158789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:23.160331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:23.166337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:23.168422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:23.168954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:23.169441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:23.170159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:23.170693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:23.171314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:23.343583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:23.352493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:23.353979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:23.355129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4e785297-a28e-480a-92ec-9a04415af895 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.203641 Aug 22 16:05:23.355722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 366/747] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:23 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:24.378997 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:24.379983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:24.386928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:24.387490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:24.387926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:24.388834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:24.389295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:24.389901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:24.534156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:24.542366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:24.543896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:24.545039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-febcd65a-897a-4df6-bd23-aac38c7e2176 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.170732 Aug 22 16:05:24.545592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 382/748] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:24 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:25.567793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:25.568392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:25.574890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:25.575416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:25.575856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:25.576549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:25.577002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:25.577428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:25.707078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:25.715057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:25.716583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:25.717718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-364f2b96-da50-49f3-b814-d3a5672e1e5a tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.153943 Aug 22 16:05:25.718278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 367/749] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:25 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:26.740826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:26.741435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:26.748136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:26.748621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:26.749052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:26.749782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:26.750233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:26.750660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:26.890019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:26.900704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:26.902226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:26.903835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3afa4582-5f75-4ead-b7e7-3024834444f4 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.166636 Aug 22 16:05:26.904475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 383/750] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:26 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:27.927725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:27.928429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:27.934442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:27.934923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:27.935380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:27.936102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:27.936549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:27.936970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:28.079593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:28.087987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:28.089488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:28.090649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7a3aa7ac-3a6e-4f46-92c7-ebe98e7bde9f tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.167491 Aug 22 16:05:28.091213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 368/751] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:27 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:29.113452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:29.114140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:29.116436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=32 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:29.130078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:29.130587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:29.131022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:29.131774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:29.132233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:29.132663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:29.350331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-45a13730-746c-48dc-8429-2995dd7ebed8 req-936248db-4f00-4f73-b68d-3f08b4f2f69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d1084c-7c3d-47e1-b746-a0a6c7cf03f0", "name": "network-vif-plugged", "status": "completed", "tag": "df382da6-9308-4a07-bf51-aa9988affd3b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:05:29.352452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:29.362046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-45a13730-746c-48dc-8429-2995dd7ebed8 req-936248db-4f00-4f73-b68d-3f08b4f2f69c service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:29.362664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:29.363094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-45a13730-746c-48dc-8429-2995dd7ebed8 req-936248db-4f00-4f73-b68d-3f08b4f2f69c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:29.363809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-45a13730-746c-48dc-8429-2995dd7ebed8 req-936248db-4f00-4f73-b68d-3f08b4f2f69c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:29.364269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:29.365477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-44672620-ce31-4401-a1cc-42b79c5ddd25 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.256502 Aug 22 16:05:29.366185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 384/752] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:29 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:29.376143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-45a13730-746c-48dc-8429-2995dd7ebed8 req-936248db-4f00-4f73-b68d-3f08b4f2f69c service nova] Creating event network-vif-plugged:df382da6-9308-4a07-bf51-aa9988affd3b for instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 on hv-cinder-85400 Aug 22 16:05:29.381542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-45a13730-746c-48dc-8429-2995dd7ebed8 req-936248db-4f00-4f73-b68d-3f08b4f2f69c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035313 Aug 22 16:05:29.382289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 369/753] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:30.389357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:30.389955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:30.397102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:30.397580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:30.398015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:30.398705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:30.399157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:30.399605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:30.531870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:30.540421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:30.541947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:30.543130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c5514705-d343-404b-93fe-131b2e4c0233 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.157851 Aug 22 16:05:30.543729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 385/754] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:30 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:31.568271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:31.568982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:31.576085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:31.576578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:31.577014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:31.578246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:31.578704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:31.579336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:31.734326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:31.743033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:31.744792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:31.745935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7dd13369-f018-4f19-b53f-5daee16d332b tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1730 microversion: 2.20 time: 0.183463 Aug 22 16:05:31.746583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 370/755] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:31 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:32.769063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:32.769707 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:32.776218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:32.776703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:32.777141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:32.777840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:32.778298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:32.778731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:32.913489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:32.921620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:32.923102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:32.924307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-964b254d-a89f-4d43-99ad-deeeb6d2d128 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1717 microversion: 2.20 time: 0.159214 Aug 22 16:05:32.924911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 386/756] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:05:32 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:05:39.990624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:39.991146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:39.997672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:39.998151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:39.998585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:39.999393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:39.999853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:40.000276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:40.022645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fe0196bf-037b-4813-b012-a64b97748cb8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/ips" status: 200 len: 150 microversion: 2.1 time: 0.035951 Aug 22 16:05:40.023211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 371/757] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 16:05:39 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:41.355178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfef331d-e7b4-4906-8b67-6ef8d69c8405"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:05:41.357637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:41.364714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:41.365193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:41.365660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:41.366316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:41.366768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:41.367199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:41.369572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:41.652638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f644d217-248a-4014-bcf9-a7c666492e54 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "POST /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301196 Aug 22 16:05:41.653514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 387/758] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:05:41 2022] POST /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:45.596632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:45.597211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:45.603603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:45.604202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:45.604697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:45.605573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:45.606150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:45.606629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:45.630085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ed3707fc-2014-408e-ac22-ecf5d6fb097b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/ips" status: 200 len: 146 microversion: 2.1 time: 0.038066 Aug 22 16:05:45.630689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 372/759] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Aug 22 16:05:45 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:46.961611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2af28431-ec73-43a8-b350-ccd800071fe1"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:05:46.964082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:46.970667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:46.971168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:46.971636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:46.972376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:46.972838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:46.973269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:47.246754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d055e2c0-ef5a-4273-81ad-70cbdff9e269 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289219 Aug 22 16:05:47.247388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 388/760] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:05:46 2022] POST /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:49.276410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:49.276917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:49.284010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:49.284510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:49.284943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:49.285635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:49.286080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:49.286498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:49.289183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=54 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:49.370655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lazy-loading 'services' on Instance uuid 3c028eac-791c-40aa-b4d4-249a7ca144c3 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:05:49.465657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d75d96d4-7482-4012-a083-af7bc023464d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments/cfef331d-e7b4-4906-8b67-6ef8d69c8405" status: 202 len: 0 microversion: 2.1 time: 0.192909 Aug 22 16:05:49.466332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 373/761] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:05:49 2022] DELETE /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments/cfef331d-e7b4-4906-8b67-6ef8d69c8405 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:05:49.476063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:49.478616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:49.485518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:49.486019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:49.486470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:49.487234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:49.487756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:49.488288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:49.520417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-84dae3ee-cca6-4c3b-aa54-106891907492 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049362 Aug 22 16:05:49.521521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 389/762] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:49 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:50.535087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:50.538016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:50.544510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:50.544995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:50.545434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:50.546126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:50.547233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:50.548131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:50.576302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4296ded3-e9b1-43c4-84fe-2d312ad06fff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046980 Aug 22 16:05:50.576851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 374/763] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:50 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:51.588879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:51.591053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:51.597664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:51.598149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:51.598586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:51.599278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:51.599762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:51.600187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:51.630135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d7741568-83df-4dba-bc14-e559a8394633 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Aug 22 16:05:51.630686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 390/764] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:51 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:52.642605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:52.644834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:52.651175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:52.651689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:52.652126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:52.652852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:52.653305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:52.653756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:52.682784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e87a3e8-87c3-494a-aa85-91a248053290 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Aug 22 16:05:52.683345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 375/765] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:52 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:53.695575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:53.697734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:53.704778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:53.705259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:53.705697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:53.706638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:53.707091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:53.707552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:53.738241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cea2ae8f-0e06-4360-a3d2-d68b07488c17 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046620 Aug 22 16:05:53.738785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 391/766] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:53 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:54.751977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:54.754135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:54.756609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=20 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:54.761864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:54.762355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:54.762802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:54.763536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:54.763994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:54.764416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:54.793990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cbe8d2e0-192f-4e89-8510-3b0d7f943a66 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046887 Aug 22 16:05:54.794546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 376/767] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:54 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:55.807717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:55.810070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:55.817113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:55.817600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:55.818041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:55.818740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:55.819197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:55.819652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:55.828791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:55.830972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:55.837576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:55.838045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:55.838469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:55.839152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:55.839621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:55.840036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:55.850112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a10e8353-90ce-4479-9329-2c09a5edbc2d tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046803 Aug 22 16:05:55.850674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 392/768] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:55 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:55.868822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6f894e66-abfc-4bfc-acb2-db3141814ded tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044489 Aug 22 16:05:55.870016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 377/769] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:55 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:05:55.881476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:55.881966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:55.888141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:55.888626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:55.889061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:55.889890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:55.890869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:55.891295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:55.919562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bf471210-95d4-4d12-a15f-88287bab2340 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/2af28431-ec73-43a8-b350-ccd800071fe1" status: 200 len: 194 microversion: 2.1 time: 0.041927 Aug 22 16:05:55.920154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 393/770] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Aug 22 16:05:55 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/2af28431-ec73-43a8-b350-ccd800071fe1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:56.862439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:56.864638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:56.871779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:56.872275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:56.872714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:56.873418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:56.873872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:56.874333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:56.904877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-32116a15-12fe-4fba-9715-f51b43d05590 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046370 Aug 22 16:05:56.905432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 378/771] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:05:56 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 16:05:56.967281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:56.967804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:56.974860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:56.975354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:56.975821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:56.976513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:56.976970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:56.977399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:57.002544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:05:57.077004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ec0ba0cd-b1c1-446e-9d6e-a21a6440324a tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 204 len: 0 microversion: 2.1 time: 0.113343 Aug 22 16:05:57.078163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 394/772] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:05:56 2022] DELETE /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:05:57.086748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:57.087502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:57.093966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:57.094442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:57.094876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:57.095605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:57.096057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:57.096480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:57.228542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:57.236310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a137e81d-ef99-4aee-91ba-9f489b26c8f4 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1680 microversion: 2.1 time: 0.153424 Aug 22 16:05:57.237125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 379/773] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:05:57 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:05:57.262163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7eb4d8f-fa01-4bee-9c78-02d185f6f3b4"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:05:57.264568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:57.271169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:57.271722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:57.272172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:57.272901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:57.273399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:57.273843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:58.257893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:58.258484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:58.264782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:58.265258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:58.265684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:58.266417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:58.266860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:58.267275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:58.395474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:58.403209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f0588164-5896-4435-a5cd-d8644f52d541 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1680 microversion: 2.1 time: 0.149168 Aug 22 16:05:58.403805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 380/774] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:05:58 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:05:58.782829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a444806d-a67f-4838-89d4-0450a0be26c6 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "POST /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.524861 Aug 22 16:05:58.783799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 395/775] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:05:57 2022] POST /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments => generated 194 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:05:59.425530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:05:59.426102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:05:59.432438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:59.432916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:59.433350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:59.434041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:59.434503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:59.434919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:59.572843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b896f9378dc4188868734e05ddd39fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d570fd37c0043c3b572d6a228bd0ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:05:59.581526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a339cd2e-666f-48cb-9b37-2fa30b049f2b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 200 len: 1680 microversion: 2.1 time: 0.160333 Aug 22 16:05:59.582102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 381/776] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:05:59 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:05:59.876464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-24384629-7c35-4907-a01d-ba17d06ada53 req-e7f4e790-6c51-4753-9fa8-0f5ba5ba0ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c028eac-791c-40aa-b4d4-249a7ca144c3", "name": "network-vif-deleted", "tag": "119081dd-b841-49d3-95c6-a369dd4a5c49"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:05:59.882755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:59.887905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-24384629-7c35-4907-a01d-ba17d06ada53 req-e7f4e790-6c51-4753-9fa8-0f5ba5ba0ae3 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:05:59.888394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-24384629-7c35-4907-a01d-ba17d06ada53 req-e7f4e790-6c51-4753-9fa8-0f5ba5ba0ae3 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:05:59.888831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-24384629-7c35-4907-a01d-ba17d06ada53 req-e7f4e790-6c51-4753-9fa8-0f5ba5ba0ae3 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:05:59.902466 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-24384629-7c35-4907-a01d-ba17d06ada53 req-e7f4e790-6c51-4753-9fa8-0f5ba5ba0ae3 service nova] Creating event network-vif-deleted:119081dd-b841-49d3-95c6-a369dd4a5c49 for instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 on hv-cinder-85400 Aug 22 16:05:59.908375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-24384629-7c35-4907-a01d-ba17d06ada53 req-e7f4e790-6c51-4753-9fa8-0f5ba5ba0ae3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036329 Aug 22 16:05:59.909604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 396/777] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:00.604417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:00.605159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:00.612998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:00.613491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:00.613926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:00.614633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:00.615143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:00.615647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:00.632339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 HTTP/1.1 Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:00.633995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:00.635838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '3c028eac-791c-40aa-b4d4-249a7ca144c3'} Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:00.636823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:00.638339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:00.639946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:00.639946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-749b0c72-e4f7-498a-a82b-f42b086b9bff tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 404 len: 111 microversion: 2.1 time: 0.034928 Aug 22 16:06:00.639946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 382/778] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:00 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:00.646139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-89004b89-376a-48ae-a893-8ef367e04141 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '.version_select at 0x7feca02fb9d0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:00.665160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-89004b89-376a-48ae-a893-8ef367e04141 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146641828" status: 202 len: 0 microversion: 2.1 time: 0.024255 Aug 22 16:06:00.666026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 397/779] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Aug 22 16:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146641828 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:06:02.703448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:02.703965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:02.710541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:02.711025 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:02.711489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:02.712181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:02.712634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:02.713056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:02.726428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 HTTP/1.1 Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:02.728008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.729523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '3c028eac-791c-40aa-b4d4-249a7ca144c3'} Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:02.730456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.731893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.733521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:02.733521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-19202cba-56b1-4b28-92f2-03fdc4fab0ec tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 404 len: 111 microversion: 2.1 time: 0.030470 Aug 22 16:06:02.733521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 383/780] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:06:02 2022] DELETE /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:02.738345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:02.739080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 3c028eac-791c-40aa-b4d4-249a7ca144c3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:02.745756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:02.746245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:02.746688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:02.747419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:02.747881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:02.748309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:02.761852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 HTTP/1.1 Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:02.763523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.765826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '3c028eac-791c-40aa-b4d4-249a7ca144c3'} Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:02.766661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. Aug 22 16:06:02.768486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:02.769847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 3c028eac-791c-40aa-b4d4-249a7ca144c3 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:02.769847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-598ed482-ed82-483a-a1c9-00fa72f9e689 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3" status: 404 len: 111 microversion: 2.1 time: 0.030980 Aug 22 16:06:02.769847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 398/781] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:02 2022] GET /compute/v2.1/servers/3c028eac-791c-40aa-b4d4-249a7ca144c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:03.903629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:03.904129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:03.911197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:03.911794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:03.912224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:03.912943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:03.913962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:03.913962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:03.927169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e HTTP/1.1 Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:03.928758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.930382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '1d63d81b-79b9-4a1a-9643-dcfd5866f65e'} Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:03.931318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.932829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.934381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:03.934381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-662cdc94-8c39-468a-afad-2ad9aaf156e3 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 404 len: 111 microversion: 2.1 time: 0.030432 Aug 22 16:06:03.934381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 384/782] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:06:03 2022] DELETE /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:03.939268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:03.939906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 1d63d81b-79b9-4a1a-9643-dcfd5866f65e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:03.946260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:03.946728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:03.947153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:03.947933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:03.948421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:03.948836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:03.965320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e HTTP/1.1 Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:03.966839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.968474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '1d63d81b-79b9-4a1a-9643-dcfd5866f65e'} Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:03.969337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. Aug 22 16:06:03.970752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:03.972202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 1d63d81b-79b9-4a1a-9643-dcfd5866f65e could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:03.972202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3143e401-d64f-41e4-b7b3-c741f09c2ebd tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e" status: 404 len: 111 microversion: 2.1 time: 0.033422 Aug 22 16:06:03.972202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 399/783] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:03 2022] GET /compute/v2.1/servers/1d63d81b-79b9-4a1a-9643-dcfd5866f65e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:03.976900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:03.977405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:03.983486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:03.983979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:03.984411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:03.985107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:03.985562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:03.985987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:04.000278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 HTTP/1.1 Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:04.001834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.003141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '8b535aef-666c-4f54-896d-e94dc94dee48'} Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:04.003902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.005303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.007074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:04.007074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-09820306-b810-48cd-a355-35725a9911db tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 404 len: 111 microversion: 2.1 time: 0.030329 Aug 22 16:06:04.007074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 385/784] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:06:03 2022] DELETE /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:04.011851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:04.012489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 8b535aef-666c-4f54-896d-e94dc94dee48] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:04.019373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:04.019866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:04.020306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:04.021040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:04.021502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:04.021928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:04.035807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 HTTP/1.1 Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:04.037305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.038833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '8b535aef-666c-4f54-896d-e94dc94dee48'} Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:04.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. Aug 22 16:06:04.041313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:04.042825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 8b535aef-666c-4f54-896d-e94dc94dee48 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:04.042825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5c357c79-0bad-4ff1-99b8-d5d3fb632790 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48" status: 404 len: 111 microversion: 2.1 time: 0.030716 Aug 22 16:06:04.042825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 400/785] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:04 2022] GET /compute/v2.1/servers/8b535aef-666c-4f54-896d-e94dc94dee48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:05.191597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:05.192451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:05.200761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:05.201244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:05.201689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:05.202432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:05.203464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:05.203884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:05.229421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 HTTP/1.1 Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:05.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.233850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '2cbc6b6e-511f-4f80-8f1c-10fc819eb319'} Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:05.234687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.235968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.249079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:05.249079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-74b945a8-fafd-42eb-9228-995cdc554f0b tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 404 len: 111 microversion: 2.1 time: 0.047287 Aug 22 16:06:05.249079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 386/786] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:06:05 2022] DELETE /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:05.249897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:05.249897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] [instance: 2cbc6b6e-511f-4f80-8f1c-10fc819eb319] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:05.254525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:05.255022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:05.256393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:05.256393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:05.256856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:05.257173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:05.274854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] HTTP exception thrown: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Request method failure captured: Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 HTTP/1.1 Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fFoZicXYkHqmkOOpbvAyFtCl8waigPnyPxlecOl1kDyoMYzEirwyX6gAn20ivDwQ9eg3BUIaaWHFD_rSzRxYP00nIGk_zT4FUd843XyxOQEWSRjElRkRqN97mw0yZoEiIUvxxMRDnVufbJCGVq-urYfXEUz15myERZ1Y1z6hvAsP4 Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:05.276714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d570fd37c0043c3b572d6a228bd0ff0", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d570fd37c0043c3b572d6a228bd0ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d570fd37c0043c3b572d6a228bd0ff0"}]}] Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 4d570fd37c0043c3b572d6a228bd0ff0 Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993227091 Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 1b896f9378dc4188868734e05ddd39fb Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-993227091-project Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.278571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '2cbc6b6e-511f-4f80-8f1c-10fc819eb319'} Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:05.279857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. Aug 22 16:06:05.282066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:05.283407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] Returning 404 to user: Instance 2cbc6b6e-511f-4f80-8f1c-10fc819eb319 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:05.283407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16937cea-df2d-4e9c-ae10-66b8e69621c8 tempest-AttachVolumeNegativeTest-993227091 tempest-AttachVolumeNegativeTest-993227091-project] 10.222.0.40 "GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319" status: 404 len: 111 microversion: 2.1 time: 0.036772 Aug 22 16:06:05.283407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 401/787] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:05 2022] GET /compute/v2.1/servers/2cbc6b6e-511f-4f80-8f1c-10fc819eb319 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 16:06:06.386689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:06.388993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:06.400014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:06.400384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:06.400876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:06.401842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:06.402417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:06.402888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:06.445001 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4b570f08-6514-4a1e-a99f-8265206ecfcd tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062490 Aug 22 16:06:06.445977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 387/788] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:06:06 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:06.588720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:06.595646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:06.605000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:06.605517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:06.605986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:06.606720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:06.607222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:06.607676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:06.624137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:06.645425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ed57c2e9-0d97-43ba-8690-90cee940a1ab tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/2af28431-ec73-43a8-b350-ccd800071fe1" status: 200 len: 194 microversion: 2.1 time: 0.060689 Aug 22 16:06:06.646136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 402/789] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Aug 22 16:06:06 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/2af28431-ec73-43a8-b350-ccd800071fe1 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:06:06.657530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:06.658020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:06.664032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:06.664518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:06.664956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:06.665649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:06.666092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:06.666506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:06.749412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lazy-loading 'services' on Instance uuid 948652d7-0fab-4122-b9e0-048548956aad {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:06:06.825505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c50315b8-5531-4df9-8f03-848b2598fca7 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/2af28431-ec73-43a8-b350-ccd800071fe1" status: 202 len: 0 microversion: 2.1 time: 0.172347 Aug 22 16:06:06.826023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 388/790] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:06:06 2022] DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/2af28431-ec73-43a8-b350-ccd800071fe1 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 16:06:09.065786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:09.066455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:09.075934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:09.076704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:09.077269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:09.077892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:09.078353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:09.078802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:09.113916 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-29fbab8e-17e4-4f83-840d-8d3eafdfedc9 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/d7eb4d8f-fa01-4bee-9c78-02d185f6f3b4" status: 200 len: 194 microversion: 2.1 time: 0.060257 Aug 22 16:06:09.114448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 403/791] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Aug 22 16:06:09 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/d7eb4d8f-fa01-4bee-9c78-02d185f6f3b4 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:06:09.129244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:09.130443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:09.138406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:09.139048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:09.139579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:09.140374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:09.140892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:09.141378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:09.235647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lazy-loading 'services' on Instance uuid 948652d7-0fab-4122-b9e0-048548956aad {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:06:09.307311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-008651d1-ec61-455a-99b8-bf7eda3977ac tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/d7eb4d8f-fa01-4bee-9c78-02d185f6f3b4" status: 202 len: 0 microversion: 2.1 time: 0.185344 Aug 22 16:06:09.307894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 389/792] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:06:09 2022] DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments/d7eb4d8f-fa01-4bee-9c78-02d185f6f3b4 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:06:10.496605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:10.499625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:10.508461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:10.508958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:10.509572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:10.510458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:10.511127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:10.511746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:10.547561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e10ca1c7-7063-40db-811d-3ae8f18726ed tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054576 Aug 22 16:06:10.548295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 404/793] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:06:10 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 16:06:10.665375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:10.667792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:10.674848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:10.675256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:10.675713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:10.676417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:10.676874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:10.677294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:10.708744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b551c5fd-1708-4d6b-83de-1ad7a7f3adfe tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048547 Aug 22 16:06:10.709320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 390/794] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:06:10 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 16:06:10.773200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:10.773689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:10.779939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:10.780432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:10.780876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:10.782125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:10.782585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:10.783015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:10.808851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:06:10.891647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-09dc05bc-8703-4c17-8694-8d3a27b8416b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 204 len: 0 microversion: 2.1 time: 0.122013 Aug 22 16:06:10.892763 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 405/795] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:06:10 2022] DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:06:10.900828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:10.901455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:10.908593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:10.909106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:10.909527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:10.910385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:10.910873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:10.911299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:10.914225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:11.052604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:11.060500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b7bd95ae-a066-435c-9318-78932426971b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1673 microversion: 2.1 time: 0.163849 Aug 22 16:06:11.061072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 391/796] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:10 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:11.585921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1f931057-acde-4b38-b391-b7bc11e38dad tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c2a7f70>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:11.638847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1f931057-acde-4b38-b391-b7bc11e38dad tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/da9f61de-cab1-483c-b86a-4c823049d462" status: 200 len: 351 microversion: 2.1 time: 0.060913 Aug 22 16:06:11.639455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 406/797] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 16:06:11 2022] GET /compute/v2.1/os-volumes/da9f61de-cab1-483c-b86a-4c823049d462 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:12.082497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:12.083094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:12.089610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:12.090095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:12.090517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:12.091212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:12.091711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:12.092123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:12.251078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:12.259372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9c903f22-c9eb-4418-9bbd-d233f130850b tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1673 microversion: 2.1 time: 0.180890 Aug 22 16:06:12.260123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 392/798] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:12 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:12.984912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7ef6026-d609-499e-b269-3a95a67cc253 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c0fa4c0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:13.036731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7ef6026-d609-499e-b269-3a95a67cc253 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/522987f5-858b-4a37-b602-8c82433d33d5" status: 200 len: 350 microversion: 2.1 time: 0.056538 Aug 22 16:06:13.037325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 407/799] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 16:06:12 2022] GET /compute/v2.1/os-volumes/522987f5-858b-4a37-b602-8c82433d33d5 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:13.281100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:13.282060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:13.289163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:13.290283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:13.290729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:13.291606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:13.292072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:13.292635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:13.447626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:13.455514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6bbc5009-33f3-4e28-8cd9-b177980c169f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1673 microversion: 2.1 time: 0.178444 Aug 22 16:06:13.456909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 393/800] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:13 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:14.000193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-a6ef2be6-2c15-4e7c-b979-a2d47cede30e req-34718bec-1c69-49ff-a7ba-afbf8ea0d1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948652d7-0fab-4122-b9e0-048548956aad", "name": "network-vif-deleted", "tag": "af08d308-ed70-4a64-86ea-d9f76c5617af"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:06:14.010505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a6ef2be6-2c15-4e7c-b979-a2d47cede30e req-34718bec-1c69-49ff-a7ba-afbf8ea0d1e2 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:14.010988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a6ef2be6-2c15-4e7c-b979-a2d47cede30e req-34718bec-1c69-49ff-a7ba-afbf8ea0d1e2 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:14.011453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a6ef2be6-2c15-4e7c-b979-a2d47cede30e req-34718bec-1c69-49ff-a7ba-afbf8ea0d1e2 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:14.029860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-a6ef2be6-2c15-4e7c-b979-a2d47cede30e req-34718bec-1c69-49ff-a7ba-afbf8ea0d1e2 service nova] Creating event network-vif-deleted:af08d308-ed70-4a64-86ea-d9f76c5617af for instance 948652d7-0fab-4122-b9e0-048548956aad on hv-cinder-85400 Aug 22 16:06:14.036834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-a6ef2be6-2c15-4e7c-b979-a2d47cede30e req-34718bec-1c69-49ff-a7ba-afbf8ea0d1e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040836 Aug 22 16:06:14.038130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 408/801] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:14.423971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3a1be531-86ae-45ce-a09f-6f21b6f92394 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c18bca0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.475267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3a1be531-86ae-45ce-a09f-6f21b6f92394 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/02ae9050-a52b-4f04-94a7-243189506d0b" status: 200 len: 351 microversion: 2.1 time: 0.057858 Aug 22 16:06:14.475860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 394/802] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Aug 22 16:06:14 2022] GET /compute/v2.1/os-volumes/02ae9050-a52b-4f04-94a7-243189506d0b => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:14.479321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.480364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:14.489321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7d19cc96-8575-45b2-9fd9-153991c5a853 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c0e93a0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.490096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:14.490698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:14.491297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:14.492515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:14.493250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:14.494219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:14.541080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:14.542247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:14.544025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:14.544759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lazy-loading 'fault' on Instance uuid 948652d7-0fab-4122-b9e0-048548956aad {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:06:14.615538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244fd44e53dd4b1986abb6e4acba632b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1440505c4e8e45918dcfaa217afe59bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:14.632345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-09664313-5e62-4bc2-b640-9aa1b9fea126 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 200 len: 1326 microversion: 2.1 time: 0.157782 Aug 22 16:06:14.634380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 409/803] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:14 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:14.636670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7d19cc96-8575-45b2-9fd9-153991c5a853 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.151908 Aug 22 16:06:14.637638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 395/804] 10.222.0.40 () {58 vars in 1134 bytes} [Mon Aug 22 16:06:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:06:14.659463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a75ccedb-38a2-4c82-9264-f20d3e7f1efc tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7feca0326790>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.708867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.712391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:14.719641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:14.720134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:14.720570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:14.721285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:14.721813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:14.722166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:14.754869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b6a2201a-5833-41f9-919b-c6518bde2936 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051887 Aug 22 16:06:14.755480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 396/805] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Aug 22 16:06:14 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:06:14.803558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a75ccedb-38a2-4c82-9264-f20d3e7f1efc tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.148229 Aug 22 16:06:14.814284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 410/806] 10.222.0.40 () {58 vars in 1149 bytes} [Mon Aug 22 16:06:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:14.821201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-251aca89-dc81-4b7c-9571-611c707dd17c tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c107940>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.837410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.837979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:14.844580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:14.845159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:14.845665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:14.846449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:14.846974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:14.847810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:14.883131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:06:14.907804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-251aca89-dc81-4b7c-9571-611c707dd17c tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091730 Aug 22 16:06:14.908381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 397/807] 10.222.0.40 () {58 vars in 1134 bytes} [Mon Aug 22 16:06:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:14.921107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-847b6de8-e88b-490b-8fef-3d0ebb0196bc tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c1b83a0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.976704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7a7dca57-d666-4f7e-88f6-90688c5bf6dc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 204 len: 0 microversion: 2.20 time: 0.143238 Aug 22 16:06:14.978407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 411/808] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Aug 22 16:06:14 2022] DELETE /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 16:06:14.990138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:14.991515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:15.003019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:15.004061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:15.004881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:15.006165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:15.007206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:15.007955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:15.044603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-847b6de8-e88b-490b-8fef-3d0ebb0196bc tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.126915 Aug 22 16:06:15.045541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 398/809] 10.222.0.40 () {58 vars in 1167 bytes} [Mon Aug 22 16:06:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:15.070744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-893c8fde-9296-4202-be5f-61d4fb0c2d9b tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c1154c0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:15.202787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-893c8fde-9296-4202-be5f-61d4fb0c2d9b tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.137807 Aug 22 16:06:15.202787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 399/810] 10.222.0.40 () {58 vars in 1170 bytes} [Mon Aug 22 16:06:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:06:15.217848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e23f7c91-7b99-47c4-8400-54b430bd1b62 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c1b8f70>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:15.221354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:15.241004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:15.242801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:15.244229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a37ecf2b-82b7-44ae-9a59-394015fd15a7 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.261289 Aug 22 16:06:15.256304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 412/811] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:06:14 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:06:15.311964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e23f7c91-7b99-47c4-8400-54b430bd1b62 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.098161 Aug 22 16:06:15.312613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 400/812] 10.222.0.40 () {58 vars in 1155 bytes} [Mon Aug 22 16:06:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:15.325755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3477f7f7-a0d6-492f-880e-5953bd7bc8a1 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c0fa790>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:15.408194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3477f7f7-a0d6-492f-880e-5953bd7bc8a1 tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086172 Aug 22 16:06:15.408768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 413/813] 10.222.0.40 () {58 vars in 1188 bytes} [Mon Aug 22 16:06:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:15.422300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d148fbf4-067e-43e0-a1d8-22017656662f tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] Calling method '.version_select at 0x7fec9c107d30>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:15.504558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d148fbf4-067e-43e0-a1d8-22017656662f tempest-VolumesTestJSON-104869228 tempest-VolumesTestJSON-104869228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086554 Aug 22 16:06:15.505146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 401/814] 10.222.0.40 () {58 vars in 1155 bytes} [Mon Aug 22 16:06:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:15.655528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:15.656761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:15.662709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:15.663192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:15.663669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:15.664363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:15.664819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:15.665253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:15.679170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] HTTP exception thrown: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Request method failure captured: Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad HTTP/1.1 Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6g3HyjtXAS3kw76C26-uIODiaQElsXsDrqkjybN7UIh4_aCD-wauqAfzdHM9K9mJh6satjbdvYDtJZMv9IrrVW5FAR1hVE5-6FoO9dERwJII3B1UUHqJXvaHST3hkctSgxSosylnd6wF7MWMZmGv57hTZlZoJRc99ewLsECBNorka4 Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:15.680855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1440505c4e8e45918dcfaa217afe59bc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}] Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 244fd44e53dd4b1986abb6e4acba632b Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:15.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '948652d7-0fab-4122-b9e0-048548956aad'} Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:15.683266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:15.684693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:15.685976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Returning 404 to user: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:15.685976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6dceb863-b36e-49b8-80ae-71c544f79a05 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 404 len: 111 microversion: 2.1 time: 0.030759 Aug 22 16:06:15.685976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 414/815] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:15 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:15.691118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4eb402ce-708b-4353-aa2c-7fdfa2502d47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '.version_select at 0x7fec9c1153a0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:15.711420 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4eb402ce-708b-4353-aa2c-7fdfa2502d47 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-930361147" status: 202 len: 0 microversion: 2.1 time: 0.024008 Aug 22 16:06:15.712045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 402/816] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Aug 22 16:06:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-930361147 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:06:16.272683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:16.273848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:16.283856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:16.284359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:16.284860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:16.285527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:16.286001 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:16.286430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:16.444187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:16.458640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:16.461343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:16.463630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ed6a6cbd-14b4-41f9-86a1-71b3ce571c60 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1723 microversion: 2.20 time: 0.198604 Aug 22 16:06:16.464642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 415/817] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:06:16 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:06:17.430214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-40d402cf-0590-4b41-a75d-d7a8807088dc req-43099b1e-5645-4390-b4e8-756edbfa4cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d1084c-7c3d-47e1-b746-a0a6c7cf03f0", "name": "network-vif-deleted", "tag": "df382da6-9308-4a07-bf51-aa9988affd3b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:06:17.445434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-40d402cf-0590-4b41-a75d-d7a8807088dc req-43099b1e-5645-4390-b4e8-756edbfa4cd4 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:17.446262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-40d402cf-0590-4b41-a75d-d7a8807088dc req-43099b1e-5645-4390-b4e8-756edbfa4cd4 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:17.446700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-40d402cf-0590-4b41-a75d-d7a8807088dc req-43099b1e-5645-4390-b4e8-756edbfa4cd4 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:17.471530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-40d402cf-0590-4b41-a75d-d7a8807088dc req-43099b1e-5645-4390-b4e8-756edbfa4cd4 service nova] Creating event network-vif-deleted:df382da6-9308-4a07-bf51-aa9988affd3b for instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 on hv-cinder-85400 Aug 22 16:06:17.478410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-40d402cf-0590-4b41-a75d-d7a8807088dc req-43099b1e-5645-4390-b4e8-756edbfa4cd4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056847 Aug 22 16:06:17.479763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 403/818] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:17.489287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:17.490020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:17.498602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:17.499254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:17.499756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:17.500567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:17.500959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:17.501382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:17.580870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:17.590434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:17.605184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c71533864af94653be067b61e1c83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8f1eeb5f85409eb243790c361f247a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:17.611251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3ab385cf-bc95-49be-8e7c-9f40d8541aa1 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 200 len: 1365 microversion: 2.20 time: 0.126565 Aug 22 16:06:17.615759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 416/819] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:06:17 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 16:06:18.637355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:18.638054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:18.645112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:18.645598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:18.646032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:18.647282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:18.647282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:18.647619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:18.661333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] HTTP exception thrown: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Request method failure captured: Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 HTTP/1.1 Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fPv1RE8Zt4UfsztciHEEkDGdZxIbXMwtjJxxF7e0XvKyfHOV0--TwA1pQNR32RZ_el0i40Ia3P26hw-J32ra397cUZMLVOcYsUK6sXEn_C-kMtHLAwhPOyD1Us6BB-2u9CvRXS3vOj5IkZTmDEKPZqT-NlDmxQnaBF4IYl9vVZ5Lg Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:18.662969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5d8f1eeb5f85409eb243790c361f247a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}] Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: c71533864af94653be067b61e1c83789 Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:18.664728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '26d1084c-7c3d-47e1-b746-a0a6c7cf03f0'} Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:18.665465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:18.667048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.668624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Returning 404 to user: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:18.668624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7194d706-fac1-4733-b57c-6c0b79822655 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 404 len: 111 microversion: 2.20 time: 0.031544 Aug 22 16:06:18.668624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 404/820] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:06:18 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:06:18.675239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7aa92d00-11da-4eda-a7e6-6b49c4ceaacc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '.version_select at 0x7fec9c0f3310>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:18.693632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7aa92d00-11da-4eda-a7e6-6b49c4ceaacc tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-878913686" status: 204 len: 0 microversion: 2.20 time: 0.022976 Aug 22 16:06:18.694190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 417/821] 10.222.0.40 () {60 vars in 1259 bytes} [Mon Aug 22 16:06:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-878913686 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 16:06:18.734882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:18.735669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:18.745556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:18.746070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:18.746519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:18.747242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:18.748598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:18.749206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:18.769942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] HTTP exception thrown: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Request method failure captured: Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad HTTP/1.1 Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6g3HyjtXAS3kw76C26-uIODiaQElsXsDrqkjybN7UIh4_aCD-wauqAfzdHM9K9mJh6satjbdvYDtJZMv9IrrVW5FAR1hVE5-6FoO9dERwJII3B1UUHqJXvaHST3hkctSgxSosylnd6wF7MWMZmGv57hTZlZoJRc99ewLsECBNorka4 Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:18.771537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1440505c4e8e45918dcfaa217afe59bc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}] Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 244fd44e53dd4b1986abb6e4acba632b Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.772900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '948652d7-0fab-4122-b9e0-048548956aad'} Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:18.774327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.775840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.777129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Returning 404 to user: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:18.777129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ae72855f-1857-446b-98dc-fa15c40fad5a tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 404 len: 111 microversion: 2.1 time: 0.043051 Aug 22 16:06:18.777129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 405/822] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:06:18 2022] DELETE /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:18.781850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:18.782327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 948652d7-0fab-4122-b9e0-048548956aad] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:18.791109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:18.791637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:18.792080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:18.792832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:18.793290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:18.793745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:18.809159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] HTTP exception thrown: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Request method failure captured: Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad HTTP/1.1 Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6g3HyjtXAS3kw76C26-uIODiaQElsXsDrqkjybN7UIh4_aCD-wauqAfzdHM9K9mJh6satjbdvYDtJZMv9IrrVW5FAR1hVE5-6FoO9dERwJII3B1UUHqJXvaHST3hkctSgxSosylnd6wF7MWMZmGv57hTZlZoJRc99ewLsECBNorka4 Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:18.814209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1440505c4e8e45918dcfaa217afe59bc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}] Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 244fd44e53dd4b1986abb6e4acba632b Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.816929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '948652d7-0fab-4122-b9e0-048548956aad'} Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:18.818266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. Aug 22 16:06:18.820129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:18.821731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Returning 404 to user: Instance 948652d7-0fab-4122-b9e0-048548956aad could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:18.821731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f740bfa1-7485-4c57-a90f-bb84e5be254f tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad" status: 404 len: 111 microversion: 2.1 time: 0.038701 Aug 22 16:06:18.821731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 418/823] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:18 2022] GET /compute/v2.1/servers/948652d7-0fab-4122-b9e0-048548956aad => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:19.992023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:19.992628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:19.999339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:20.000358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:20.000794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:20.001529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:20.001991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:20.002406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:20.019724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] HTTP exception thrown: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Request method failure captured: Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 HTTP/1.1 Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6g3HyjtXAS3kw76C26-uIODiaQElsXsDrqkjybN7UIh4_aCD-wauqAfzdHM9K9mJh6satjbdvYDtJZMv9IrrVW5FAR1hVE5-6FoO9dERwJII3B1UUHqJXvaHST3hkctSgxSosylnd6wF7MWMZmGv57hTZlZoJRc99ewLsECBNorka4 Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:20.021326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1440505c4e8e45918dcfaa217afe59bc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}] Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 244fd44e53dd4b1986abb6e4acba632b Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.022726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '6a2a6980-8937-485c-b773-bdd5eb754ca7'} Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:20.023518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.024748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.026017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Returning 404 to user: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:20.026017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f5dc7342-7881-4e94-895e-3c9ba5cae34c tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 404 len: 111 microversion: 2.1 time: 0.034709 Aug 22 16:06:20.026017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 406/824] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:06:19 2022] DELETE /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:20.031890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:20.032861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] [instance: 6a2a6980-8937-485c-b773-bdd5eb754ca7] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:20.039257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:20.039921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:20.040363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:20.041201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:20.041596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:20.042020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:20.057458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] HTTP exception thrown: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Request method failure captured: Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 HTTP/1.1 Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6g3HyjtXAS3kw76C26-uIODiaQElsXsDrqkjybN7UIh4_aCD-wauqAfzdHM9K9mJh6satjbdvYDtJZMv9IrrVW5FAR1hVE5-6FoO9dERwJII3B1UUHqJXvaHST3hkctSgxSosylnd6wF7MWMZmGv57hTZlZoJRc99ewLsECBNorka4 Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:20.059026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1440505c4e8e45918dcfaa217afe59bc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1440505c4e8e45918dcfaa217afe59bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1440505c4e8e45918dcfaa217afe59bc"}]}] Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 1440505c4e8e45918dcfaa217afe59bc Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1374541809 Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 244fd44e53dd4b1986abb6e4acba632b Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeTestJSON-1374541809-project Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.060537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '6a2a6980-8937-485c-b773-bdd5eb754ca7'} Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:20.064138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. Aug 22 16:06:20.065587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.067130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] Returning 404 to user: Instance 6a2a6980-8937-485c-b773-bdd5eb754ca7 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:20.067130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-352d72dd-1911-490e-a5ad-246d57cd6297 tempest-AttachVolumeTestJSON-1374541809 tempest-AttachVolumeTestJSON-1374541809-project] 10.222.0.40 "GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7" status: 404 len: 111 microversion: 2.1 time: 0.032705 Aug 22 16:06:20.067130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 419/825] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:20 2022] GET /compute/v2.1/servers/6a2a6980-8937-485c-b773-bdd5eb754ca7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:20.570600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:20.571225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:20.582261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:20.583656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:20.584703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:20.586351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:20.587539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:20.588660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:20.608017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] HTTP exception thrown: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Request method failure captured: Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 HTTP/1.1 Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fPv1RE8Zt4UfsztciHEEkDGdZxIbXMwtjJxxF7e0XvKyfHOV0--TwA1pQNR32RZ_el0i40Ia3P26hw-J32ra397cUZMLVOcYsUK6sXEn_C-kMtHLAwhPOyD1Us6BB-2u9CvRXS3vOj5IkZTmDEKPZqT-NlDmxQnaBF4IYl9vVZ5Lg Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:20.610676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5d8f1eeb5f85409eb243790c361f247a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}] Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: c71533864af94653be067b61e1c83789 Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.612113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '26d1084c-7c3d-47e1-b746-a0a6c7cf03f0'} Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:20.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.613991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.616850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Returning 404 to user: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:20.617961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1b414dc0-5926-49f6-9206-a78388b69cd3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 404 len: 111 microversion: 2.20 time: 0.052700 Aug 22 16:06:20.618749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 407/826] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Aug 22 16:06:20 2022] DELETE /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:06:20.629339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:20.630086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:20.636904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:20.637399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:20.638015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:20.638820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:20.639297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:20.639772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:20.659372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] HTTP exception thrown: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Request method failure captured: Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 HTTP/1.1 Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fPv1RE8Zt4UfsztciHEEkDGdZxIbXMwtjJxxF7e0XvKyfHOV0--TwA1pQNR32RZ_el0i40Ia3P26hw-J32ra397cUZMLVOcYsUK6sXEn_C-kMtHLAwhPOyD1Us6BB-2u9CvRXS3vOj5IkZTmDEKPZqT-NlDmxQnaBF4IYl9vVZ5Lg Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:20.660872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5d8f1eeb5f85409eb243790c361f247a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}] Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: c71533864af94653be067b61e1c83789 Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.662479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '26d1084c-7c3d-47e1-b746-a0a6c7cf03f0'} Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:20.663216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. Aug 22 16:06:20.664563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:20.665605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Returning 404 to user: Instance 26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:20.665605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9edfb316-1ff9-44d8-90b1-f6ec37daee94 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0" status: 404 len: 111 microversion: 2.20 time: 0.039117 Aug 22 16:06:20.666961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 420/827] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:06:20 2022] GET /compute/v2.1/servers/26d1084c-7c3d-47e1-b746-a0a6c7cf03f0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:06:21.831428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:21.832220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:21.838774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:21.839518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:21.840102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:21.841292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:21.841893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:21.842494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:21.879291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] HTTP exception thrown: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Request method failure captured: Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf HTTP/1.1 Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6fPv1RE8Zt4UfsztciHEEkDGdZxIbXMwtjJxxF7e0XvKyfHOV0--TwA1pQNR32RZ_el0i40Ia3P26hw-J32ra397cUZMLVOcYsUK6sXEn_C-kMtHLAwhPOyD1Us6BB-2u9CvRXS3vOj5IkZTmDEKPZqT-NlDmxQnaBF4IYl9vVZ5Lg Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:06:21.881045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5d8f1eeb5f85409eb243790c361f247a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}] Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: c71533864af94653be067b61e1c83789 Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.882628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '31a6012e-3710-4ea5-9cfa-7e0e34321caf'} Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:21.883373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.884539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.885697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Returning 404 to user: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:21.885697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-da1271f9-9009-4a97-9448-ec076ab427a3 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 404 len: 111 microversion: 2.20 time: 0.055861 Aug 22 16:06:21.887264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 408/828] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Aug 22 16:06:21 2022] DELETE /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:06:21.892630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:21.893838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] [instance: 31a6012e-3710-4ea5-9cfa-7e0e34321caf] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:21.908640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:21.909354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:21.910111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:21.911530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:21.913181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:21.913777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:21.937923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] HTTP exception thrown: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Request method failure captured: Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf HTTP/1.1 Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6fPv1RE8Zt4UfsztciHEEkDGdZxIbXMwtjJxxF7e0XvKyfHOV0--TwA1pQNR32RZ_el0i40Ia3P26hw-J32ra397cUZMLVOcYsUK6sXEn_C-kMtHLAwhPOyD1Us6BB-2u9CvRXS3vOj5IkZTmDEKPZqT-NlDmxQnaBF4IYl9vVZ5Lg Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:06:21.940432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5d8f1eeb5f85409eb243790c361f247a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5d8f1eeb5f85409eb243790c361f247a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d8f1eeb5f85409eb243790c361f247a"}]}] Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 5d8f1eeb5f85409eb243790c361f247a Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1101559767 Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: c71533864af94653be067b61e1c83789 Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1101559767-project Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.941819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '31a6012e-3710-4ea5-9cfa-7e0e34321caf'} Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:06:21.942526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. Aug 22 16:06:21.943842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:06:21.945843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] Returning 404 to user: Instance 31a6012e-3710-4ea5-9cfa-7e0e34321caf could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:06:21.946949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cdb30bde-8c18-45cf-a142-f571511db183 tempest-AttachVolumeShelveTestJSON-1101559767 tempest-AttachVolumeShelveTestJSON-1101559767-project] 10.222.0.40 "GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf" status: 404 len: 111 microversion: 2.20 time: 0.058576 Aug 22 16:06:21.948154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 421/829] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Aug 22 16:06:21 2022] GET /compute/v2.1/servers/31a6012e-3710-4ea5-9cfa-7e0e34321caf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:06:42.680246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-553478936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-579268431", "security_groups": [{"name": "tempest-secgroup-smoke-1751899005"}], "block_device_mapping_v2": [{"uuid": "daa6bc26-2b4a-44dd-926e-fe7674100127", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c654763e-5b64-4bcf-9232-fa5fc5f9ad5d"}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:06:42.698522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:42.699846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=35 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:42.871375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] validate_networks() for [('c654763e-5b64-4bcf-9232-fa5fc5f9ad5d', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:06:43.785646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:06:43.786162 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:06:43.786648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:06:43.787124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:06:43.787618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:06:43.797009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:43.797561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:43.798058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:43.799432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:43.800300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:43.800874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:43.828886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Getting quotas for project cb5f34dcc6dd4d6c9f52af4cc142bb13. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:06:43.833618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Getting quotas for user f50207197b8b46cea2ea40ca346bd8a0 and project cb5f34dcc6dd4d6c9f52af4cc142bb13. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:06:43.930294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:06:43.949177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='daa6bc26-2b4a-44dd-926e-fe7674100127',volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:06:44.200397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0355a1f7-9385-448c-9886-65fad8f85222 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.525621 Aug 22 16:06:44.216109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-289ced8c-7c76-4827-9782-f170078aba1d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:44.218324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-289ced8c-7c76-4827-9782-f170078aba1d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:44.222437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:44.222794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 409/830] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:06:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 16:06:44.224052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:44.310889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-289ced8c-7c76-4827-9782-f170078aba1d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:44.323961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-289ced8c-7c76-4827-9782-f170078aba1d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1093 microversion: 2.1 time: 0.113597 Aug 22 16:06:44.327532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 422/831] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:44 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1093 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:45.357883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:45.359302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:45.367475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:45.368221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:45.369138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:45.370074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:45.370599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:45.371413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:45.485635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:45.496297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-590bf9f9-a128-4f16-a7e5-928fe90d429e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1191 microversion: 2.1 time: 0.142638 Aug 22 16:06:45.505663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 410/832] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:45 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1191 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:46.520352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:46.520800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:46.531197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:46.531750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:46.532285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:46.533094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:46.541214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:46.541678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:46.912961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:46.924855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7a1829ae-5314-4f50-8d70-751b44dd6e0a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1277 microversion: 2.1 time: 0.410050 Aug 22 16:06:46.943457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 423/833] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:46 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1277 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:47.578393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-f6ee17a6-eb93-424e-a3d8-e5c864f634c6 req-604d096f-e3bf-4f73-8375-820f1e97c58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d36279b-140d-4f9c-bd43-609a981d98d5", "tag": "f1a99de3-868a-4e9d-9f7c-167a63d748ad"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:06:47.590829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f6ee17a6-eb93-424e-a3d8-e5c864f634c6 req-604d096f-e3bf-4f73-8375-820f1e97c58a service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:47.591306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f6ee17a6-eb93-424e-a3d8-e5c864f634c6 req-604d096f-e3bf-4f73-8375-820f1e97c58a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:47.591788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f6ee17a6-eb93-424e-a3d8-e5c864f634c6 req-604d096f-e3bf-4f73-8375-820f1e97c58a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:47.605936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-f6ee17a6-eb93-424e-a3d8-e5c864f634c6 req-604d096f-e3bf-4f73-8375-820f1e97c58a service nova] Creating event network-changed:f1a99de3-868a-4e9d-9f7c-167a63d748ad for instance 9d36279b-140d-4f9c-bd43-609a981d98d5 on hv-cinder-85400 Aug 22 16:06:47.612211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-f6ee17a6-eb93-424e-a3d8-e5c864f634c6 req-604d096f-e3bf-4f73-8375-820f1e97c58a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038291 Aug 22 16:06:47.613719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 411/834] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:47.956450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:47.958666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:47.969484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:47.969984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:47.971060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:47.972207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:47.973091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:47.974302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:47.983299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1171011602", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "networks": [{"uuid": "1304bc3f-428a-4985-9159-963a4e9df0bd"}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:06:48.055015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] validate_networks() for [('1304bc3f-428a-4985-9159-963a4e9df0bd', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:06:48.202205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:48.211158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f7149be7-0a39-4cb7-8b4c-7673b16bf636 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.261832 Aug 22 16:06:48.211769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 424/835] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:47 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:48.458920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:06:48.459372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:06:48.459818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:06:48.460242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:06:48.460732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:06:48.471567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:48.472331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:48.472971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:48.473787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:48.474462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:48.475013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:48.499925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Getting quotas for project 107e661d345144e5839f114905c2fa79. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:06:48.511064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Getting quotas for user da73365a36d54715b84a7dda10a06800 and project 107e661d345144e5839f114905c2fa79. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:06:48.524136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:06:48.526580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:06:48.592952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-64fffad2-de5a-4961-bb3b-f5ce2702f284 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613762 Aug 22 16:06:48.594238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 412/836] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 16:06:48.605317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-410739b3-9bff-4269-849d-ab1ca8325a16 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:48.605938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-410739b3-9bff-4269-849d-ab1ca8325a16 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:48.698547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-410739b3-9bff-4269-849d-ab1ca8325a16 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:48.706589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-410739b3-9bff-4269-849d-ab1ca8325a16 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1214 microversion: 2.1 time: 0.105152 Aug 22 16:06:48.721397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 425/837] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:48 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:49.231981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:49.232601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:49.240121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:49.240609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:49.241161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:49.241727 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:49.242173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:49.242595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:49.378379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:49.387111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-34c676ba-002a-441e-b832-a0829c75374c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.158988 Aug 22 16:06:49.387736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 413/838] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:49 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:49.728646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:49.729969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:49.740912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:49.742040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:49.742679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:49.743713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:49.744474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:49.745320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:49.829270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:49.840077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-79e8edaa-387f-47c8-9988-3ec219ba2123 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1284 microversion: 2.1 time: 0.115408 Aug 22 16:06:49.841052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 426/839] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:49 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:50.409706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:50.410325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:50.418172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:50.418859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:50.419099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:50.420521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:50.421263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:50.422515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:50.612125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:50.620082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d2c60355-8f7e-4418-a291-c9c3f6399586 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.215888 Aug 22 16:06:50.624235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 414/840] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:50 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:50.863141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:50.864133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:50.871622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:50.872101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:50.872540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:50.873246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:50.873737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:50.874165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:51.007181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:51.016307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a95fefd7-e5d3-479d-8281-6d8314b7b712 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1314 microversion: 2.1 time: 0.157831 Aug 22 16:06:51.017244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 427/841] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:50 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:06:51.041252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-e3789529-d55a-443c-b1c8-739e17aa5ef9 req-3b4d3270-3199-47a6-9880-e810fff91921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c08d8b-538b-4a08-8fbb-13ecb5113fa3", "tag": "f2fb9ff3-f33c-48b6-b996-8dec94148ef1"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:06:51.052456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e3789529-d55a-443c-b1c8-739e17aa5ef9 req-3b4d3270-3199-47a6-9880-e810fff91921 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:51.053039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e3789529-d55a-443c-b1c8-739e17aa5ef9 req-3b4d3270-3199-47a6-9880-e810fff91921 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:51.053546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e3789529-d55a-443c-b1c8-739e17aa5ef9 req-3b4d3270-3199-47a6-9880-e810fff91921 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:51.066850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-e3789529-d55a-443c-b1c8-739e17aa5ef9 req-3b4d3270-3199-47a6-9880-e810fff91921 service nova] Creating event network-changed:f2fb9ff3-f33c-48b6-b996-8dec94148ef1 for instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 on hv-cinder-85400 Aug 22 16:06:51.071956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-e3789529-d55a-443c-b1c8-739e17aa5ef9 req-3b4d3270-3199-47a6-9880-e810fff91921 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034392 Aug 22 16:06:51.072854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 415/842] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:51.642007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:51.642989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:51.649216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:51.649699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:51.650134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:51.650835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:51.651293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:51.651739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:51.795749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:51.804092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ffe15546-0d40-46e0-8ade-97ead70cb513 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.166825 Aug 22 16:06:51.804658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 428/843] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:51 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:52.039850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:52.040558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:52.047313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:52.047842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:52.048370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:52.049652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:52.050459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:52.050889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:52.199431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:52.209238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-be8da158-63c6-4c2e-9bfa-376a6a3a6030 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1314 microversion: 2.1 time: 0.174217 Aug 22 16:06:52.209820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 416/844] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:52 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:06:52.826707 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:52.827502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:52.835131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:52.835646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:52.836078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:52.836770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:52.837222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:52.837644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:52.971620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:52.979782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-31743a95-c4ec-46c5-a4a9-3684c2a5fb3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.157887 Aug 22 16:06:52.980610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 429/845] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:52 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:53.230712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:53.231316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:53.238212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:53.238687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:53.239120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:53.239841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:53.240287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:53.240703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:53.374109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:53.381654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3657ff5c-f5b6-44be-826b-861b92f198a6 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1314 microversion: 2.1 time: 0.154860 Aug 22 16:06:53.382220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 417/846] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:53 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:54.003558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:54.004322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:54.011266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:54.011797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:54.012243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:54.012942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:54.013400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:54.013840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:54.316449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:54.324098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1e34e1b4-be59-4067-970e-eecf257b12d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.325745 Aug 22 16:06:54.324652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 430/847] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:53 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:54.402412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:54.403029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:54.410055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:54.410561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:54.410998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:54.411759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:54.412204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:54.412632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:54.585472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:54.593599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d27d8aaa-2f2d-4cf0-9e20-adfb7a613d59 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1314 microversion: 2.1 time: 0.195018 Aug 22 16:06:54.594179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 418/848] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:54 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:55.348818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:55.350376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:55.359964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:55.360682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:55.361101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:55.361808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:55.362311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:55.362733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:55.513371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:55.525413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-71bdcda3-aee5-4ab9-bea0-28448b317e21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.181435 Aug 22 16:06:55.525974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 431/849] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:55 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:55.615267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:55.616722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:55.624179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:55.624808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:55.625368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:55.626316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:55.627193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:55.627969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:55.798174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:55.809348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9906748c-b564-4b95-90ac-13a67f11fbf2 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1314 microversion: 2.1 time: 0.199128 Aug 22 16:06:55.810333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 419/850] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:55 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:55.894765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-4fd53a2e-877b-4a83-9fad-4fdac24a5454 req-ac2f2f36-5a69-416a-b5cc-3daeadd0bd34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c08d8b-538b-4a08-8fbb-13ecb5113fa3", "name": "network-vif-plugged", "status": "completed", "tag": "f2fb9ff3-f33c-48b6-b996-8dec94148ef1"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:06:55.904093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-4fd53a2e-877b-4a83-9fad-4fdac24a5454 req-ac2f2f36-5a69-416a-b5cc-3daeadd0bd34 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:55.904767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-4fd53a2e-877b-4a83-9fad-4fdac24a5454 req-ac2f2f36-5a69-416a-b5cc-3daeadd0bd34 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:55.905443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-4fd53a2e-877b-4a83-9fad-4fdac24a5454 req-ac2f2f36-5a69-416a-b5cc-3daeadd0bd34 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:55.921460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-4fd53a2e-877b-4a83-9fad-4fdac24a5454 req-ac2f2f36-5a69-416a-b5cc-3daeadd0bd34 service nova] Creating event network-vif-plugged:f2fb9ff3-f33c-48b6-b996-8dec94148ef1 for instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 on hv-cinder-85400 Aug 22 16:06:55.929561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-4fd53a2e-877b-4a83-9fad-4fdac24a5454 req-ac2f2f36-5a69-416a-b5cc-3daeadd0bd34 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037953 Aug 22 16:06:55.930835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 432/851] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:56.546034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:56.546646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:56.555661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:56.555661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:56.555661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:56.555661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:56.556006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:56.556006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:56.733532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:56.741474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3cd21033-4e72-4d01-ba6b-1afd4caece60 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.199176 Aug 22 16:06:56.741961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 420/852] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:56 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:56.832845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:56.833808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:56.840651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:56.841115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:56.841559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:56.842457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:56.842920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:56.843372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:56.990226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:56.998407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4478b9b7-9312-41b9-b69a-503089ed6db8 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1314 microversion: 2.1 time: 0.170445 Aug 22 16:06:56.999060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 433/853] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:56 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:57.762830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:57.763481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:57.770711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:57.771515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:57.771952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:57.772642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:57.773265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:57.773681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:57.917648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:57.926665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bb05d361-c037-4829-8495-89a16adbd53b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.168051 Aug 22 16:06:57.927503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 421/854] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:57 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:57.956680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-6a74503a-ab87-4b82-8752-faca81fdb0bf req-f99c8299-7130-43d9-9b3d-9d1a4bc34046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d36279b-140d-4f9c-bd43-609a981d98d5", "name": "network-vif-plugged", "status": "completed", "tag": "f1a99de3-868a-4e9d-9f7c-167a63d748ad"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:06:57.969091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6a74503a-ab87-4b82-8752-faca81fdb0bf req-f99c8299-7130-43d9-9b3d-9d1a4bc34046 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:57.969569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6a74503a-ab87-4b82-8752-faca81fdb0bf req-f99c8299-7130-43d9-9b3d-9d1a4bc34046 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:57.970017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6a74503a-ab87-4b82-8752-faca81fdb0bf req-f99c8299-7130-43d9-9b3d-9d1a4bc34046 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:57.981600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-6a74503a-ab87-4b82-8752-faca81fdb0bf req-f99c8299-7130-43d9-9b3d-9d1a4bc34046 service nova] Creating event network-vif-plugged:f1a99de3-868a-4e9d-9f7c-167a63d748ad for instance 9d36279b-140d-4f9c-bd43-609a981d98d5 on hv-cinder-85400 Aug 22 16:06:57.988190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-6a74503a-ab87-4b82-8752-faca81fdb0bf req-f99c8299-7130-43d9-9b3d-9d1a4bc34046 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035159 Aug 22 16:06:57.988884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 434/855] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:06:58.019868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:58.020684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:58.026685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:58.027251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:58.027791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:58.028587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:58.029232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:58.029781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:58.172770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:58.181467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c03d9229-0095-4056-9d80-1f22bd0203a0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1498 microversion: 2.1 time: 0.165553 Aug 22 16:06:58.182051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 422/856] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:58 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:58.827025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:58.831265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:58.831865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:58.838481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:58.838964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:58.839432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:58.840120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:58.840573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:58.840999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:58.866754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:06:58.940725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-484a8d06-3ef7-49c8-9b32-9d6b2ac92c6e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "DELETE /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 204 len: 0 microversion: 2.1 time: 0.114267 Aug 22 16:06:58.941253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 435/857] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:06:58 2022] DELETE /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:06:58.948187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:58.948896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:58.949625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:06:58.950330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:06:58.950832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:58.951512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=12 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:58.956738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:58.957227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:58.957662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:58.957787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:58.958509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:58.958638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:58.958956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:58.959125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:58.959534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:58.959685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:06:58.960132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:06:58.960550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:06:59.179633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:59.184201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:06:59.191094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d734d7da-172b-4c1e-9bb8-6a7b714c6ca5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.246556 Aug 22 16:06:59.193398 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 423/858] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:58 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:06:59.193633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1bf83651-f326-4f61-9cbb-6d461ae22553 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1504 microversion: 2.1 time: 0.248051 Aug 22 16:06:59.194193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 436/859] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:06:58 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:07:00.214428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:00.214960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:00.215355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:00.215459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:00.221431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:00.221619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:00.221917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:00.222042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:00.222351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:00.222482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:00.223047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:00.223162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:00.223526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:00.223630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:00.223953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:00.224056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:00.424799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:00.428133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:00.432910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d7e45534-c28c-4187-acce-745d204067de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.222427 Aug 22 16:07:00.433504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 424/860] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:00 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:07:00.436781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0175bbf0-5900-40ab-a94d-2f72815b0075 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1504 microversion: 2.1 time: 0.226179 Aug 22 16:07:00.437334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 437/861] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:00 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:07:01.454691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:01.455284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:01.457867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:01.458735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:01.462262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:01.462775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:01.463211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:01.464092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:01.464547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:01.464971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:01.465084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:01.465514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:01.465954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:01.466656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:01.467118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:01.467576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:01.655590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:01.663874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-593ced5b-b7e9-482c-8a0f-3e212952d742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.213617 Aug 22 16:07:01.664455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 425/862] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:01 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:01.670095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:01.678781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bcbc8d4c-a709-4c94-9ceb-9819150f74c9 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1504 microversion: 2.1 time: 0.224735 Aug 22 16:07:01.679426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 438/863] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:01 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:07:02.685141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:02.685793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:02.692144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:02.692630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:02.693068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:02.693788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:02.694242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:02.694675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:02.700358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:02.700973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:02.707278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:02.707784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:02.708217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:02.709177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:02.709629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:02.710045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:02.903763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:02.912502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1b06a189-340f-4385-849b-a088d66a19a8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1265 microversion: 2.1 time: 0.230627 Aug 22 16:07:02.914024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 426/864] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:02 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:02.918475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:02.926644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4f353dd7-5b90-4f6d-b2de-2a8d563515be tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1504 microversion: 2.1 time: 0.230072 Aug 22 16:07:02.927218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 439/865] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:02 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:07:03.934299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:03.934849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:03.942675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:03.943047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:03.943786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:03.944681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:03.945459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:03.945935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:03.949898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:03.951199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:03.958809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:03.960590 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:03.960590 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:03.960917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:03.961337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:03.961925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:03.966689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:04.248932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:04.255410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:04.258551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ff68d2f3-6c8d-4e00-b6bf-c2a361f26a79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1452 microversion: 2.1 time: 0.328053 Aug 22 16:07:04.259483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 427/866] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:03 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1452 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:04.274651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bef9c33d-c908-4dbd-b2e4-b1d359fabe58 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1504 microversion: 2.1 time: 0.328997 Aug 22 16:07:04.277534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 440/867] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:03 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:04.293777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:04.294480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:04.302034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:04.302518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:04.302992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:04.303828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:04.304288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:04.304715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:04.309406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:04.452058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:04.460195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-09e20add-386d-4daa-801b-d574c3336e75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1452 microversion: 2.1 time: 0.184491 Aug 22 16:07:04.460767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 428/868] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:04 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:07:04.674941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-e74499c2-bf0f-44a6-a0d6-fbb4cadc3a44 req-7d1c28f6-da4d-43c1-9b16-1a171f18b41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c08d8b-538b-4a08-8fbb-13ecb5113fa3", "name": "network-vif-deleted", "tag": "f2fb9ff3-f33c-48b6-b996-8dec94148ef1"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:07:04.702179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e74499c2-bf0f-44a6-a0d6-fbb4cadc3a44 req-7d1c28f6-da4d-43c1-9b16-1a171f18b41e service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:04.708147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e74499c2-bf0f-44a6-a0d6-fbb4cadc3a44 req-7d1c28f6-da4d-43c1-9b16-1a171f18b41e service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:04.708867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e74499c2-bf0f-44a6-a0d6-fbb4cadc3a44 req-7d1c28f6-da4d-43c1-9b16-1a171f18b41e service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:04.725904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-e74499c2-bf0f-44a6-a0d6-fbb4cadc3a44 req-7d1c28f6-da4d-43c1-9b16-1a171f18b41e service nova] Creating event network-vif-deleted:f2fb9ff3-f33c-48b6-b996-8dec94148ef1 for instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 on hv-cinder-85400 Aug 22 16:07:04.733751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-e74499c2-bf0f-44a6-a0d6-fbb4cadc3a44 req-7d1c28f6-da4d-43c1-9b16-1a171f18b41e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064859 Aug 22 16:07:04.735211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 441/869] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:07:05.298274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:05.299807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:05.307691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:05.308513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:05.309156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:05.310121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:05.310834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:05.311464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:05.351951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:05.352618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:05.353261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:05.353892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lazy-loading 'fault' on Instance uuid 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:07:05.519530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:05.526920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-066e1618-38f3-4a9e-8f9f-19c0a9a27c73 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 200 len: 1304 microversion: 2.1 time: 0.232640 Aug 22 16:07:05.527839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 429/870] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:05 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 1304 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:06.549341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:06.550157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: 18c08d8b-538b-4a08-8fbb-13ecb5113fa3] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:06.558044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:06.559168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:06.560875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:06.560875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:06.561282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:06.561956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:06.597827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] HTTP exception thrown: Instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 could not be found. Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Request method failure captured: Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 HTTP/1.1 Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6mVfpiMylpdmOcJBI7LuNidQlP321Nf9rNdUf1NIAJugIlcW8_LXJrJurqXInsFb6dwKqBiJZdTi-9CbklvfQOzeEB6NpdiAvk_cRzRmFPw00DuPh7N54_n1R7kjdzl0A0rX6WNz8GfZpT6iVt-SO_-tcuewsQYqSUpDgbHnBgkvN8 Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 107e661d345144e5839f114905c2fa79 Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesActionsTest-323006419 Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:07:06.604270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/107e661d345144e5839f114905c2fa79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_107e661d345144e5839f114905c2fa79", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/107e661d345144e5839f114905c2fa79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/107e661d345144e5839f114905c2fa79"}]}] Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesActionsTest-323006419 Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 107e661d345144e5839f114905c2fa79 Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesActionsTest-323006419 Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesActionsTest-323006419-project Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: da73365a36d54715b84a7dda10a06800 Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesActionsTest-323006419-project Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 could not be found. Aug 22 16:07:06.606032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '18c08d8b-538b-4a08-8fbb-13ecb5113fa3'} Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 could not be found. Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:07:06.606993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 could not be found. Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 could not be found. Aug 22 16:07:06.608820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:06.611531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Returning 404 to user: Instance 18c08d8b-538b-4a08-8fbb-13ecb5113fa3 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:07:06.612857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0200e238-e0d1-40d4-901f-5ff56e10182f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3" status: 404 len: 111 microversion: 2.1 time: 0.067974 Aug 22 16:07:06.622836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 430/871] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:06 2022] GET /compute/v2.1/servers/18c08d8b-538b-4a08-8fbb-13ecb5113fa3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:07:06.803270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-182816765", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "networks": [{"uuid": "1304bc3f-428a-4985-9159-963a4e9df0bd"}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:07:06.881149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-3c7d41b1-6d85-4fac-81d7-8d7ebb43064f req-7721d4cd-1b4c-4009-ab91-5da321bffdff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d36279b-140d-4f9c-bd43-609a981d98d5", "tag": "f1a99de3-868a-4e9d-9f7c-167a63d748ad"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:07:06.893224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-3c7d41b1-6d85-4fac-81d7-8d7ebb43064f req-7721d4cd-1b4c-4009-ab91-5da321bffdff service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:06.894355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-3c7d41b1-6d85-4fac-81d7-8d7ebb43064f req-7721d4cd-1b4c-4009-ab91-5da321bffdff service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:06.895067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-3c7d41b1-6d85-4fac-81d7-8d7ebb43064f req-7721d4cd-1b4c-4009-ab91-5da321bffdff service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:06.895209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] validate_networks() for [('1304bc3f-428a-4985-9159-963a4e9df0bd', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:07:06.933850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-3c7d41b1-6d85-4fac-81d7-8d7ebb43064f req-7721d4cd-1b4c-4009-ab91-5da321bffdff service nova] Creating event network-changed:f1a99de3-868a-4e9d-9f7c-167a63d748ad for instance 9d36279b-140d-4f9c-bd43-609a981d98d5 on hv-cinder-85400 Aug 22 16:07:06.939911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-3c7d41b1-6d85-4fac-81d7-8d7ebb43064f req-7721d4cd-1b4c-4009-ab91-5da321bffdff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.400335 Aug 22 16:07:06.946242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 442/872] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:07:07.396866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:07:07.398049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:07:07.398538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:07:07.398951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:07:07.399379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:07:07.413133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:07.413613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:07.414039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:07.414761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:07.415203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:07.415645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:07.449737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Getting quotas for project 107e661d345144e5839f114905c2fa79. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:07:07.474131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Getting quotas for user da73365a36d54715b84a7dda10a06800 and project 107e661d345144e5839f114905c2fa79. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:07:07.492329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:07:07.494985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:07:07.569166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5b5b955a-68fb-4d52-974d-e7c6c01b2d40 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767493 Aug 22 16:07:07.571215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 431/873] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 16:07:07.584351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b3251f5c-f478-41fa-94af-1ab3338557c7 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:07.585075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b3251f5c-f478-41fa-94af-1ab3338557c7 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:07.665745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b3251f5c-f478-41fa-94af-1ab3338557c7 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:07.679569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b3251f5c-f478-41fa-94af-1ab3338557c7 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1213 microversion: 2.1 time: 0.100045 Aug 22 16:07:07.681467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 443/874] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:07 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:08.702498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:08.703125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:08.710110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:08.710602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:08.711038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:08.711775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:08.712229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:08.712655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:08.778595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:08.789466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f803f786-7a07-497d-96ae-66bd56524ddf tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1265 microversion: 2.1 time: 0.092242 Aug 22 16:07:08.790061 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 432/875] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:08 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:09.816328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:09.817561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:09.842472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:09.843385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:09.843969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:09.848561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:09.849305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:09.850600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:09.981669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:09.990033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c33efe27-180b-42f8-bea7-e4baaa94a54d tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.178581 Aug 22 16:07:09.990604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 444/876] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:09 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:10.321720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-7331e5df-0c3a-46bd-987f-e20171567b61 req-9a723416-eb5e-498d-a0b9-d22148f809f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc", "tag": "eaca08db-c953-4f45-b76f-5860c0e54689"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:07:10.332930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7331e5df-0c3a-46bd-987f-e20171567b61 req-9a723416-eb5e-498d-a0b9-d22148f809f4 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:10.333934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7331e5df-0c3a-46bd-987f-e20171567b61 req-9a723416-eb5e-498d-a0b9-d22148f809f4 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:10.334363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7331e5df-0c3a-46bd-987f-e20171567b61 req-9a723416-eb5e-498d-a0b9-d22148f809f4 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:10.346463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-7331e5df-0c3a-46bd-987f-e20171567b61 req-9a723416-eb5e-498d-a0b9-d22148f809f4 service nova] Creating event network-changed:eaca08db-c953-4f45-b76f-5860c0e54689 for instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc on hv-cinder-85400 Aug 22 16:07:10.351497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-7331e5df-0c3a-46bd-987f-e20171567b61 req-9a723416-eb5e-498d-a0b9-d22148f809f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033564 Aug 22 16:07:10.352084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 433/877] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:07:11.020860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:11.021525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:11.028268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:11.029099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:11.029330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:11.030026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:11.030476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:11.030898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:11.177808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:11.185931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-80740444-b2e1-43bc-b18e-e12c131259c5 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.169639 Aug 22 16:07:11.186523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 445/878] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:11 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:12.209696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:12.210463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:12.217697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:12.218221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:12.218664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:12.219439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:12.219899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:12.220364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:12.369268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:12.378582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7fe11d80-c96b-4b4f-90a6-106c745303fc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.174711 Aug 22 16:07:12.379155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 434/879] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:12 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:13.399842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:13.400809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:13.407048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:13.407580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:13.408145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:13.408888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:13.409354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:13.409782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:13.552253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:13.566266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a75650c4-545d-450c-92ac-5f06d92eab6a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.170352 Aug 22 16:07:13.567228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 446/880] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:13 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:14.600182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:14.600794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:14.603220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:14.609912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:14.610617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:14.611820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:14.612676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:14.613293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:14.613822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:14.751136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:14.759270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-992792d6-0e0b-4e31-bc4e-8b2249405dd3 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.162980 Aug 22 16:07:14.760004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 435/881] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:14 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:15.780437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:15.781131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:15.783911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:15.789665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:15.791618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:15.792002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:15.792734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:15.793191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:15.793610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:15.932934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:15.940635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-792a342e-0d23-482e-8577-a7df9600c435 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.164575 Aug 22 16:07:15.941198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 447/882] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:15 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:16.961230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:16.961983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:16.968091 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:16.968568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:16.969000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:16.969683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:16.970130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:16.970548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:17.106592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:17.114158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-499047ef-19d4-4a5e-a81b-b22b868ede9e tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.157011 Aug 22 16:07:17.114719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 436/883] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:16 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:18.135570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:18.136208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:18.138954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:18.146090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:18.146668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:18.147317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:18.148112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:18.148574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:18.149010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:18.269115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-477ec9fd-0c0d-4cd0-a085-62a5a58fa76a req-55d49705-f20a-43c7-8453-c00564cced4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc", "name": "network-vif-plugged", "status": "completed", "tag": "eaca08db-c953-4f45-b76f-5860c0e54689"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:07:18.275546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:18.276348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:18.282263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-477ec9fd-0c0d-4cd0-a085-62a5a58fa76a req-55d49705-f20a-43c7-8453-c00564cced4c service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:18.282972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-477ec9fd-0c0d-4cd0-a085-62a5a58fa76a req-55d49705-f20a-43c7-8453-c00564cced4c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:18.283440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-477ec9fd-0c0d-4cd0-a085-62a5a58fa76a req-55d49705-f20a-43c7-8453-c00564cced4c service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:18.293762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:18.299050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-477ec9fd-0c0d-4cd0-a085-62a5a58fa76a req-55d49705-f20a-43c7-8453-c00564cced4c service nova] Creating event network-vif-plugged:eaca08db-c953-4f45-b76f-5860c0e54689 for instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc on hv-cinder-85400 Aug 22 16:07:18.302794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-18289e6f-ba49-4d5e-bfba-097424da4049 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.171688 Aug 22 16:07:18.303605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 448/884] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:18 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:18.305708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-477ec9fd-0c0d-4cd0-a085-62a5a58fa76a req-55d49705-f20a-43c7-8453-c00564cced4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041033 Aug 22 16:07:18.306754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 437/885] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:07:19.323117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:19.323781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:19.330519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:19.331342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:19.331990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:19.332808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:19.333331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:19.333774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:19.476484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:19.484527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-195ef7af-60ae-4191-9c66-48c5d303cf36 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1313 microversion: 2.1 time: 0.165186 Aug 22 16:07:19.485425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 449/886] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:19 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:20.506759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:20.507400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:20.513633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:20.514113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:20.514565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:20.515256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:20.515741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:20.516166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:20.661860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:20.668818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-36bf26b9-ae2b-4a67-a97f-522720dc1e35 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1498 microversion: 2.1 time: 0.166839 Aug 22 16:07:20.669342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 438/887] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:20 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:21.815645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:21.816174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:21.822467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:21.822950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:21.823411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:21.824099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:21.824548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:21.824965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:21.851114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:07:21.932908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-431cb51f-c834-4261-83ab-532cd0dbfa1f tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 204 len: 0 microversion: 2.1 time: 0.121296 Aug 22 16:07:21.933631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 450/888] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:07:21 2022] DELETE /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:07:21.942489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:21.943448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:21.950114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:21.950603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:21.951070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:21.951809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:21.952264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:21.952692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:22.087214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:22.095654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-da342599-dac3-41a2-93da-1a3c84e54c7a tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1504 microversion: 2.1 time: 0.157360 Aug 22 16:07:22.096226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 439/889] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:21 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:23.117936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:23.118637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:23.125186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:23.125666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:23.126292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:23.127048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:23.127527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:23.128624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:23.271843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:23.280783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c5e8f38a-d736-44df-9821-5af1a73d2bd0 tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1504 microversion: 2.1 time: 0.167319 Aug 22 16:07:23.281354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 451/890] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:23 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:24.302848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:24.303498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:24.309990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:24.310318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:24.310753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:24.311484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:24.311944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:24.312370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:24.465618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da73365a36d54715b84a7dda10a06800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107e661d345144e5839f114905c2fa79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:24.475240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7e1cee86-6b84-451f-b93e-216ab915e7aa tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 200 len: 1504 microversion: 2.1 time: 0.176188 Aug 22 16:07:24.476104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 440/891] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:24 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:07:24.554158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-43f87039-c5ac-4a6e-99a6-8fc6c7bb682e req-4790d70b-eb7a-4ca8-804b-d02fb814222a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc", "name": "network-vif-deleted", "tag": "eaca08db-c953-4f45-b76f-5860c0e54689"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:07:24.565244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-43f87039-c5ac-4a6e-99a6-8fc6c7bb682e req-4790d70b-eb7a-4ca8-804b-d02fb814222a service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:24.565719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-43f87039-c5ac-4a6e-99a6-8fc6c7bb682e req-4790d70b-eb7a-4ca8-804b-d02fb814222a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:24.566697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-43f87039-c5ac-4a6e-99a6-8fc6c7bb682e req-4790d70b-eb7a-4ca8-804b-d02fb814222a service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:24.578814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-43f87039-c5ac-4a6e-99a6-8fc6c7bb682e req-4790d70b-eb7a-4ca8-804b-d02fb814222a service nova] Creating event network-vif-deleted:eaca08db-c953-4f45-b76f-5860c0e54689 for instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc on hv-cinder-85400 Aug 22 16:07:24.584921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-43f87039-c5ac-4a6e-99a6-8fc6c7bb682e req-4790d70b-eb7a-4ca8-804b-d02fb814222a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Aug 22 16:07:24.585535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 452/892] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:07:25.496049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:25.496692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] [instance: e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:25.503133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:25.504214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:25.504671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:25.505369 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:25.505823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:25.506248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:25.520343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] HTTP exception thrown: Instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc could not be found. Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Request method failure captured: Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc HTTP/1.1 Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6mVfpiMylpdmOcJBI7LuNidQlP321Nf9rNdUf1NIAJugIlcW8_LXJrJurqXInsFb6dwKqBiJZdTi-9CbklvfQOzeEB6NpdiAvk_cRzRmFPw00DuPh7N54_n1R7kjdzl0A0rX6WNz8GfZpT6iVt-SO_-tcuewsQYqSUpDgbHnBgkvN8 Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: 107e661d345144e5839f114905c2fa79 Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesActionsTest-323006419 Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:07:25.521971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/107e661d345144e5839f114905c2fa79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_107e661d345144e5839f114905c2fa79", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/107e661d345144e5839f114905c2fa79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/107e661d345144e5839f114905c2fa79"}]}] Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesActionsTest-323006419 Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 107e661d345144e5839f114905c2fa79 Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesActionsTest-323006419 Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesActionsTest-323006419-project Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: da73365a36d54715b84a7dda10a06800 Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesActionsTest-323006419-project Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc could not be found. Aug 22 16:07:25.523569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': 'e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc'} Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc could not be found. Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:07:25.524408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc could not be found. Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc could not be found. Aug 22 16:07:25.525883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:07:25.527798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] Returning 404 to user: Instance e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:07:25.527798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9cb4d7de-b990-4fd3-9b6e-787bdefa4abc tempest-VolumesActionsTest-323006419 tempest-VolumesActionsTest-323006419-project] 10.222.0.40 "GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc" status: 404 len: 111 microversion: 2.1 time: 0.031247 Aug 22 16:07:25.527798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 441/893] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:25 2022] GET /compute/v2.1/servers/e5bc266c-3aee-4b5e-9d6d-2bdb1c8f4cfc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:07:32.133714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:07:32.134337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:07:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:07:59.184888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-931122620", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:07:59.194400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:59.195197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:59.253462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] validate_networks() for None {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:07:59.567194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:07:59.567736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:07:59.568279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:07:59.568843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:07:59.569289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:07:59.580715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:59.581335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:59.582080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:59.582821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:07:59.583408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:07:59.584893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:07:59.607470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Getting quotas for project d12097df3d5a4462af686c2b5a50edb9. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:07:59.612467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Getting quotas for user 9373e2891a8c41a0beb2111d8c4e14a0 and project d12097df3d5a4462af686c2b5a50edb9. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:07:59.628713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:07:59.631904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:07:59.706059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-666333ae-c0a8-438d-bd04-46a498de4cd8 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526087 Aug 22 16:07:59.713280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 453/894] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 16:07:59.720255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-87e72816-524d-4fc6-9530-aa2c17ef6932 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:07:59.720997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-87e72816-524d-4fc6-9530-aa2c17ef6932 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:07:59.726816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=13 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:59.728385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=64 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:59.803545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-87e72816-524d-4fc6-9530-aa2c17ef6932 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:07:59.811040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-87e72816-524d-4fc6-9530-aa2c17ef6932 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1214 microversion: 2.1 time: 0.095855 Aug 22 16:07:59.816224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 442/895] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:07:59 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:00.837371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:00.838327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:00.846696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:00.847809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:00.849017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:00.849869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:00.850494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:00.851084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:00.946908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:00.959431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ea03c6f7-f30b-49ed-b020-cd080878ad49 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1266 microversion: 2.1 time: 0.126694 Aug 22 16:08:00.961079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 454/896] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:00 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:01.984438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:01.986118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:01.997519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:01.998647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:01.999281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:02.000764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:02.001404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:02.001887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:02.080045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2019772526", "imageRef": "ddf83612-5abb-4429-807e-ba9779e2dcce", "flavorRef": "452", "networks": [{"uuid": "93d8b74d-4660-45c7-8f1c-f2761f80d115"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:02.095618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:02.104349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-473182fd-e41e-44b0-9bed-21cb8334d6aa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1272 microversion: 2.1 time: 0.125027 Aug 22 16:08:02.105162 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 443/897] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:01 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:02.162084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] validate_networks() for [('93d8b74d-4660-45c7-8f1c-f2761f80d115', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:08:02.838526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:08:02.839154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:08:02.839746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:08:02.840235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:08:02.842920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:08:02.856901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:02.857666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:02.858178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:02.859703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:02.861643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:02.862522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:02.887058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Getting quotas for project b8cd9041298e400496762808cf2880eb. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:08:02.891368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Getting quotas for user 05a423ada4f24a8aae812a2495771383 and project b8cd9041298e400496762808cf2880eb. Resources: {'instances', 'cores', 'ram'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:08:02.903989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:08:02.906750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddf83612-5abb-4429-807e-ba9779e2dcce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:08:02.971962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7f7ccab5-28a3-44c8-b4e3-2417c6a86a00 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895573 Aug 22 16:08:02.972632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 455/898] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 16:08:02.984780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-44f3af52-982f-45b9-87eb-69485ace1478 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:02.985602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-44f3af52-982f-45b9-87eb-69485ace1478 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:03.086763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-44f3af52-982f-45b9-87eb-69485ace1478 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:03.109408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-44f3af52-982f-45b9-87eb-69485ace1478 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1219 microversion: 2.1 time: 0.115104 Aug 22 16:08:03.109408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 444/899] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:02 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:03.129078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:03.132364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:03.146278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:03.147086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:03.148342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:03.149319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:03.149989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:03.150621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:03.224836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:03.232595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aecde12b-9ecd-4163-abe2-47edd6bb85e0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1272 microversion: 2.1 time: 0.108362 Aug 22 16:08:03.233163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 456/900] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:03 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:04.121452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:04.122882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:04.134337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:04.136722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:04.137583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:04.139846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:04.140647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:04.141307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:04.229303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:04.251059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b723223a-cf05-4d5e-ac84-b76e4f1f6aa7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1271 microversion: 2.1 time: 0.135525 Aug 22 16:08:04.252779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 445/901] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:04 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:04.254255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:04.256319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:04.268252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:04.268723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:04.269172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:04.269909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:04.270399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:04.273327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:04.457907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-53b16001-9833-4229-aea6-30e769553c70 req-116bb058-dbcd-4e67-80c7-3ee939c55e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6515c607-b570-4e76-a152-61dc41d3f03d", "tag": "ef4ea214-2c9c-47a6-92d0-d7bf7cd23933"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:04.498277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-53b16001-9833-4229-aea6-30e769553c70 req-116bb058-dbcd-4e67-80c7-3ee939c55e95 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:04.498789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-53b16001-9833-4229-aea6-30e769553c70 req-116bb058-dbcd-4e67-80c7-3ee939c55e95 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:04.499287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-53b16001-9833-4229-aea6-30e769553c70 req-116bb058-dbcd-4e67-80c7-3ee939c55e95 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:04.532641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:04.539552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-53b16001-9833-4229-aea6-30e769553c70 req-116bb058-dbcd-4e67-80c7-3ee939c55e95 service nova] Creating event network-changed:ef4ea214-2c9c-47a6-92d0-d7bf7cd23933 for instance 6515c607-b570-4e76-a152-61dc41d3f03d on hv-cinder-85400 Aug 22 16:08:04.548764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-53b16001-9833-4229-aea6-30e769553c70 req-116bb058-dbcd-4e67-80c7-3ee939c55e95 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096239 Aug 22 16:08:04.552609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 446/902] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:08:04.571708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c3ca6f93-da6a-4e3f-a03a-aac254d15217 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1314 microversion: 2.1 time: 0.321220 Aug 22 16:08:04.572311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 457/903] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:04 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:05.283250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:05.284685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:05.296225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:05.297073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:05.297782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:05.299062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:05.299827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:05.300633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:05.389887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:05.403299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-70385fab-ad64-4d7e-be0a-1e47460a9bc1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1277 microversion: 2.1 time: 0.130028 Aug 22 16:08:05.416678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 447/904] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:05 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:05.595735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:05.596905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:05.606116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:05.606922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:05.607662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:05.608615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:05.609262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:05.609684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:05.904113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:05.912178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-598ba0d0-f0d6-437e-bf1c-8c7c1297e99e tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1314 microversion: 2.1 time: 0.320385 Aug 22 16:08:05.913513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 458/905] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:05 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:06.426785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:06.427524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:06.434893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:06.435416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:06.435854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:06.436626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:06.437131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:06.437483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:06.583397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:06.591940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-29935deb-6b81-4a28-ad76-97e44899f40c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.169336 Aug 22 16:08:06.592517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 448/906] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:06 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:06.933462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:06.934087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:06.945875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:06.949473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:06.949935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:06.950805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:06.951277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:06.959718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:07.221893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:07.232147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f48fe4cd-d247-46be-bec5-da4e63f325f1 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1314 microversion: 2.1 time: 0.301515 Aug 22 16:08:07.232147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 459/907] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:06 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:07.619997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:07.622133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:07.636399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:07.638314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:07.639393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:07.641703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:07.643457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:07.644803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:07.980858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:07.992936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-373897e9-75ec-441c-a3ee-58937400c437 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.381641 Aug 22 16:08:08.007928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 449/908] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:07 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:08.035182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-aed5badb-17b4-4b08-8d1b-2ddec9ab7a07 req-7c3b0781-f34e-4028-aed4-1a98fa298bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bb9f058-ee33-4a96-be12-be17f5ad3204", "tag": "7a0e4b26-ea80-4f67-a130-a25e80b02fe5"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:08.058473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-aed5badb-17b4-4b08-8d1b-2ddec9ab7a07 req-7c3b0781-f34e-4028-aed4-1a98fa298bf4 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:08.059021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-aed5badb-17b4-4b08-8d1b-2ddec9ab7a07 req-7c3b0781-f34e-4028-aed4-1a98fa298bf4 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:08.060042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-aed5badb-17b4-4b08-8d1b-2ddec9ab7a07 req-7c3b0781-f34e-4028-aed4-1a98fa298bf4 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:08.081278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-aed5badb-17b4-4b08-8d1b-2ddec9ab7a07 req-7c3b0781-f34e-4028-aed4-1a98fa298bf4 service nova] Creating event network-changed:7a0e4b26-ea80-4f67-a130-a25e80b02fe5 for instance 8bb9f058-ee33-4a96-be12-be17f5ad3204 on hv-cinder-85400 Aug 22 16:08:08.091228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-aed5badb-17b4-4b08-8d1b-2ddec9ab7a07 req-7c3b0781-f34e-4028-aed4-1a98fa298bf4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061655 Aug 22 16:08:08.092002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 460/909] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:08.263595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:08.265276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:08.282662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:08.284339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:08.287830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:08.290899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:08.292125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:08.293240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:08.806635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:08.817722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9963299d-54d3-4847-bee5-d71e7d98ecfa tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1314 microversion: 2.1 time: 0.564756 Aug 22 16:08:08.818541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 450/910] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:08 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:09.018132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:09.019101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:09.027572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:09.028487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:09.029086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:09.029977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:09.031189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:09.031843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:09.400583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:09.421861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-39ac9731-4121-4ccc-b237-150e7b4cdcbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.407249 Aug 22 16:08:09.435430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 461/911] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:09 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:09.841303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:09.842630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:09.856291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:09.862359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:09.863363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:09.866253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:09.867113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:09.867598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:10.217062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:10.229410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9cda7292-b69c-4111-8ac3-7713d7e75301 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1314 microversion: 2.1 time: 0.392493 Aug 22 16:08:10.230374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 451/912] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:09 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:10.445876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:10.446960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:10.521448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:10.522761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:10.523433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:10.524391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:10.526512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:10.529456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:10.924450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:10.936287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b7843652-0aca-4570-a2e4-c785f72c8536 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.494524 Aug 22 16:08:10.936943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 462/913] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:10 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:11.021011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-3bc1209f-5836-4921-b1cd-93144c8a060e req-6f6269a6-1960-4124-be00-d01bd3078b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6515c607-b570-4e76-a152-61dc41d3f03d", "name": "network-vif-plugged", "status": "completed", "tag": "ef4ea214-2c9c-47a6-92d0-d7bf7cd23933"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:11.031529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3bc1209f-5836-4921-b1cd-93144c8a060e req-6f6269a6-1960-4124-be00-d01bd3078b80 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:11.032294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3bc1209f-5836-4921-b1cd-93144c8a060e req-6f6269a6-1960-4124-be00-d01bd3078b80 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:11.032934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3bc1209f-5836-4921-b1cd-93144c8a060e req-6f6269a6-1960-4124-be00-d01bd3078b80 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:11.055369 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-3bc1209f-5836-4921-b1cd-93144c8a060e req-6f6269a6-1960-4124-be00-d01bd3078b80 service nova] Creating event network-vif-plugged:ef4ea214-2c9c-47a6-92d0-d7bf7cd23933 for instance 6515c607-b570-4e76-a152-61dc41d3f03d on hv-cinder-85400 Aug 22 16:08:11.068186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-3bc1209f-5836-4921-b1cd-93144c8a060e req-6f6269a6-1960-4124-be00-d01bd3078b80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050226 Aug 22 16:08:11.069476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 452/914] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:11.254410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:11.255858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:11.268906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:11.272060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:11.272800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:11.276288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:11.277149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:11.277829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:11.547718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:11.558495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c2a41b9f-828e-40a9-b381-4f45d63a19d5 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1314 microversion: 2.1 time: 0.310533 Aug 22 16:08:11.560084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 463/915] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:11 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:11.963724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:11.964441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:11.979213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:11.983464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:11.983944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:11.984719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:11.985203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:11.985723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:12.243118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:12.251918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3de44474-b3fd-45d7-b4d7-a6c9bbda9b1a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.294653 Aug 22 16:08:12.252661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 453/916] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:11 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:12.585996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:12.586644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:12.594457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:12.594873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:12.595304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:12.596327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:12.596726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:12.597742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:12.858373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:12.870308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fa496a31-c484-4d3a-a1ba-faa2d9ebb019 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1314 microversion: 2.1 time: 0.291700 Aug 22 16:08:12.883357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 464/917] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:12 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:13.290475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:13.293184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:13.296684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:13.301292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:13.301822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:13.302538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:13.303429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:13.304045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:13.304619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:13.523384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:13.525688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ea0def95-7c58-4e34-9893-1172c7a33311 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.238640 Aug 22 16:08:13.526544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 454/918] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:13 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:13.891648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:13.892802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:13.900802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:13.902013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=12 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:13.909693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:13.916267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:13.917049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:13.920604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:13.922024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:13.926713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:14.155849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:14.164536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6b70d3f9-3570-401a-ac25-ab692cfa8f8b tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1463 microversion: 2.1 time: 0.276831 Aug 22 16:08:14.165114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 465/919] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:13 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1463 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:14.251307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:14.252147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:14.269693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:14.270483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:14.270928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:14.272138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:14.272607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:14.273043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:14.325988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:08:14.455949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-099a99cb-8ec8-422e-b950-803882aa0d71 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 204 len: 0 microversion: 2.1 time: 0.207976 Aug 22 16:08:14.457470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 455/920] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:08:14 2022] DELETE /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:08:14.465857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:14.467083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:14.485118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:14.486063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:14.486765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:14.487900 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:14.488680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:14.490060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:14.548624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:14.551545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:14.559110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:14.560975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:14.561691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:14.562667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:14.563467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:14.564160 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:14.755897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:14.773898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cc3660ea-e114-4ece-b8d2-896600a8100c tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1469 microversion: 2.1 time: 0.312011 Aug 22 16:08:14.781763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:14.788874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 466/921] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:14 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:14.795484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b56bfa8b-b260-4f36-9e92-a06bfdcf0ad9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.251241 Aug 22 16:08:14.796793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 456/922] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:14 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:15.309374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-66d2f167-0a82-4735-855f-c2c0bc5534af req-e1fe0474-32d1-4b70-abf2-a73313c7324f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb9f058-ee33-4a96-be12-be17f5ad3204", "name": "network-vif-plugged", "status": "completed", "tag": "7a0e4b26-ea80-4f67-a130-a25e80b02fe5"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:15.327051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-66d2f167-0a82-4735-855f-c2c0bc5534af req-e1fe0474-32d1-4b70-abf2-a73313c7324f service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:15.327577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-66d2f167-0a82-4735-855f-c2c0bc5534af req-e1fe0474-32d1-4b70-abf2-a73313c7324f service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:15.328033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-66d2f167-0a82-4735-855f-c2c0bc5534af req-e1fe0474-32d1-4b70-abf2-a73313c7324f service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:15.346404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-66d2f167-0a82-4735-855f-c2c0bc5534af req-e1fe0474-32d1-4b70-abf2-a73313c7324f service nova] Creating event network-vif-plugged:7a0e4b26-ea80-4f67-a130-a25e80b02fe5 for instance 8bb9f058-ee33-4a96-be12-be17f5ad3204 on hv-cinder-85400 Aug 22 16:08:15.351636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-66d2f167-0a82-4735-855f-c2c0bc5534af req-e1fe0474-32d1-4b70-abf2-a73313c7324f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046645 Aug 22 16:08:15.352470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 467/923] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:15.850646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:15.851349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:15.853419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:15.854534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:15.870843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:15.872851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:15.873343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:15.873934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:15.874472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:15.875295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:15.875874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:15.877362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:15.877927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:15.878538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:15.879116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:15.880113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:16.255282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:16.263158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fd1360d8-29bf-4233-9e75-673cd12acfc4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.428219 Aug 22 16:08:16.267602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 468/924] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:15 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:16.311321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:16.319478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f3b12d5b-26ea-49a9-ab2b-8f09f3b83369 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1469 microversion: 2.1 time: 0.482689 Aug 22 16:08:16.333646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 457/925] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:15 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:16.718175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-1e1bbe15-da44-464d-be10-fa00bc8c55dd req-2b4a178f-7231-460f-9670-7431ad82dc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6515c607-b570-4e76-a152-61dc41d3f03d", "name": "network-vif-deleted", "tag": "ef4ea214-2c9c-47a6-92d0-d7bf7cd23933"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:16.737663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1e1bbe15-da44-464d-be10-fa00bc8c55dd req-2b4a178f-7231-460f-9670-7431ad82dc6f service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:16.738163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1e1bbe15-da44-464d-be10-fa00bc8c55dd req-2b4a178f-7231-460f-9670-7431ad82dc6f service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:16.738634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1e1bbe15-da44-464d-be10-fa00bc8c55dd req-2b4a178f-7231-460f-9670-7431ad82dc6f service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:16.780838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-1e1bbe15-da44-464d-be10-fa00bc8c55dd req-2b4a178f-7231-460f-9670-7431ad82dc6f service nova] Creating event network-vif-deleted:ef4ea214-2c9c-47a6-92d0-d7bf7cd23933 for instance 6515c607-b570-4e76-a152-61dc41d3f03d on hv-cinder-85400 Aug 22 16:08:16.796414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-1e1bbe15-da44-464d-be10-fa00bc8c55dd req-2b4a178f-7231-460f-9670-7431ad82dc6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080202 Aug 22 16:08:16.800463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 469/926] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:17.290215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:17.291596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:17.302911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:17.303852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:17.304494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:17.305385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:17.305992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:17.306565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:17.346075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:17.346773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:17.354514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:17.355006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:17.355473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:17.356412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:17.357060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:17.357670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:17.401765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:17.402514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:17.403151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:17.403629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lazy-loading 'fault' on Instance uuid 6515c607-b570-4e76-a152-61dc41d3f03d {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:08:17.462573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373e2891a8c41a0beb2111d8c4e14a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12097df3d5a4462af686c2b5a50edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:17.471127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f4dff33c-d0f8-43d6-b51a-102e5bbb96f0 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 200 len: 1304 microversion: 2.1 time: 0.129383 Aug 22 16:08:17.471739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 470/927] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:17 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:17.553313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:17.566601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-973b4d60-13dc-4b25-9755-f0cecd110ddb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1319 microversion: 2.1 time: 0.280769 Aug 22 16:08:17.571716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 458/928] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:17 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:18.497564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:18.498256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] [instance: 6515c607-b570-4e76-a152-61dc41d3f03d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:18.505896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:18.506898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:18.507432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:18.508440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:18.509176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:18.509888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:18.526518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] HTTP exception thrown: Instance 6515c607-b570-4e76-a152-61dc41d3f03d could not be found. Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Request method failure captured: Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d HTTP/1.1 Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6ndfan9smdud8RDhFOShJjjitq4W-UxpG-ohUHf6g0cna_5rFVnDY05EdSElaLB4EvC3ahxT3OzDmxqzd51jLSgEkb0gPS4Ex6iQXEHI3FpAB6BHalmbnKmC1pl76FYNk5k-uDp8Pmn7GY2lXjRbkTNcVlhmZ0axXQNwGkki3fMdP0 Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: d12097df3d5a4462af686c2b5a50edb9 Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-1344443351 Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:08:18.528838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d12097df3d5a4462af686c2b5a50edb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d12097df3d5a4462af686c2b5a50edb9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d12097df3d5a4462af686c2b5a50edb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d12097df3d5a4462af686c2b5a50edb9"}]}] Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-1344443351 Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: d12097df3d5a4462af686c2b5a50edb9 Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-1344443351 Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-1344443351-project Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 9373e2891a8c41a0beb2111d8c4e14a0 Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-1344443351-project Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 6515c607-b570-4e76-a152-61dc41d3f03d could not be found. Aug 22 16:08:18.530580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '6515c607-b570-4e76-a152-61dc41d3f03d'} Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6515c607-b570-4e76-a152-61dc41d3f03d could not be found. Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:08:18.531578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6515c607-b570-4e76-a152-61dc41d3f03d could not be found. Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6515c607-b570-4e76-a152-61dc41d3f03d could not be found. Aug 22 16:08:18.532890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:08:18.534550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] Returning 404 to user: Instance 6515c607-b570-4e76-a152-61dc41d3f03d could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:08:18.535670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-505aaba3-4902-46a8-9ae1-6879fb37e1a9 tempest-VolumesNegativeTest-1344443351 tempest-VolumesNegativeTest-1344443351-project] 10.222.0.40 "GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d" status: 404 len: 111 microversion: 2.1 time: 0.043255 Aug 22 16:08:18.536443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 471/929] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:18 2022] GET /compute/v2.1/servers/6515c607-b570-4e76-a152-61dc41d3f03d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:08:18.590305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:18.591901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:18.601138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:18.601954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:18.602619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:18.603564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:18.604232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:18.605010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:18.800680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:18.812345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-54d61978-947c-4220-9371-2a8baeb2f269 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1508 microversion: 2.1 time: 0.228313 Aug 22 16:08:18.813515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 459/930] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:18 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:23.567934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e4439273-1d55-419c-b4d6-7e16c41565f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Action: 'create', calling method: .version_select at 0x7feca02fbca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1393520262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVUulEsWJnl+VyfBArg3LCXR7jdk2BphrJ3azPq8X+52ZCQwMRML/HSlLItjqXeAFGw0kJAEGhSZgyd+MHAx5ksRs6Z3ecLx3qjVJ0yICNMdo+TN5y7wqrY1UmGR8l9Mg=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:23.586274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-e4439273-1d55-419c-b4d6-7e16c41565f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Getting quotas for project d3f48363627d49948f567e5dd81e873a. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:08:23.590823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-e4439273-1d55-419c-b4d6-7e16c41565f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Getting quotas for user a379a0d6d7ef4453a10b4727cf19eb00 and project d3f48363627d49948f567e5dd81e873a. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:08:23.626392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e4439273-1d55-419c-b4d6-7e16c41565f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.063593 Aug 22 16:08:23.626980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 472/931] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:08:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:23.685439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1730512022", "imageRef": "1c8e8585-4709-4ebb-87fb-d96aa3ea524f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1393520262", "networks": [{"uuid": "ee0ed2b1-3fc5-484b-8be4-80ff58110199"}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:23.884990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] validate_networks() for [('ee0ed2b1-3fc5-484b-8be4-80ff58110199', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:08:24.577187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:08:24.577629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:08:24.578096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:08:24.578626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:08:24.580829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:08:24.590986 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:24.591511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:24.591944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:24.592670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:24.593122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:24.593608 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:24.601906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:24.617324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Getting quotas for project d3f48363627d49948f567e5dd81e873a. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:08:24.622869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Getting quotas for user a379a0d6d7ef4453a10b4727cf19eb00 and project d3f48363627d49948f567e5dd81e873a. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:08:24.639652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:08:24.641978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c8e8585-4709-4ebb-87fb-d96aa3ea524f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:08:24.696052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e72526dd-e0b2-4ecb-bc64-d4ef09ced90b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014606 Aug 22 16:08:24.697043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 460/932] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:08:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 16:08:24.708854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4d2ff0ea-38f2-440e-8117-a78a1d055b99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:24.709681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4d2ff0ea-38f2-440e-8117-a78a1d055b99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:24.772511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d2ff0ea-38f2-440e-8117-a78a1d055b99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:24.783646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4d2ff0ea-38f2-440e-8117-a78a1d055b99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1259 microversion: 2.1 time: 0.079212 Aug 22 16:08:24.784343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 473/933] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:25.806908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:25.807565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:25.816345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:25.816879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:25.817312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:25.818018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:25.818534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:25.818999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:25.888044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:25.896675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b59988df-1dbc-4ad2-b843-8a558fa7d5e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1311 microversion: 2.1 time: 0.094192 Aug 22 16:08:25.897257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 461/934] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:26.918684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:26.920458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:26.945024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:26.945580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:26.948491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:26.950144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:26.952579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:26.954101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:27.160182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:27.201123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6550c25e-5d6e-4c1e-93b8-c3ab2dd22b98 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.287436 Aug 22 16:08:27.201731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 474/935] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:28.181186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-bed2465f-7645-439c-bc02-4408ada6231f req-7a6811cc-4567-4e61-863a-57a52e4a0b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a2bdd7-2790-42d9-914e-4dab6caaec39", "tag": "2af7b377-5d28-4879-ae25-955d593fbddf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:28.191660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-bed2465f-7645-439c-bc02-4408ada6231f req-7a6811cc-4567-4e61-863a-57a52e4a0b18 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:28.193060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-bed2465f-7645-439c-bc02-4408ada6231f req-7a6811cc-4567-4e61-863a-57a52e4a0b18 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:28.193722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-bed2465f-7645-439c-bc02-4408ada6231f req-7a6811cc-4567-4e61-863a-57a52e4a0b18 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:28.206833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-bed2465f-7645-439c-bc02-4408ada6231f req-7a6811cc-4567-4e61-863a-57a52e4a0b18 service nova] Creating event network-changed:2af7b377-5d28-4879-ae25-955d593fbddf for instance 11a2bdd7-2790-42d9-914e-4dab6caaec39 on hv-cinder-85400 Aug 22 16:08:28.214084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-bed2465f-7645-439c-bc02-4408ada6231f req-7a6811cc-4567-4e61-863a-57a52e4a0b18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036813 Aug 22 16:08:28.215449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 462/936] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:08:28.225875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:28.226521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:28.233461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:28.234230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:28.234989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:28.236003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:28.236626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:28.237360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:28.242993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:28.427232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:28.435780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b835117b-d325-40e0-9dab-ef261203d859 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.213880 Aug 22 16:08:28.436358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 475/937] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:29.459379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:29.460092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:29.468236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:29.468718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:29.469146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:29.469846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:29.470293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:29.470716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:29.619690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:29.634736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-df2a1937-78b4-4214-87b1-718715a4234c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.180575 Aug 22 16:08:29.635320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 463/938] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:30.656589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:30.658815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:30.662315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:30.667949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:30.668625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:30.669070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:30.669782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:30.670275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:30.670898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:30.812961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:30.822262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-17ecc6bd-b1ec-4b0e-9ca5-d3fc82124526 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.169632 Aug 22 16:08:30.822840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 476/939] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:31.855620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:31.856258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:31.859891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:31.864131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:31.864622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:31.865058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:31.865766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:31.866221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:31.866658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:32.010261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:32.018725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5ffc7aec-760e-4bdd-bef1-c1d6f9c38ba4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.166961 Aug 22 16:08:32.019304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 464/940] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:33.041471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:33.042236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:33.048742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:33.049236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:33.049669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:33.050376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:33.050833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:33.051926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:33.193626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:33.201259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a632a054-75a3-4c11-a9c4-cbed03ca2f13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.164630 Aug 22 16:08:33.201845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 477/941] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:34.222235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:34.223086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:34.229444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:34.229932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:34.230473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:34.231297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:34.231980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:34.232524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:34.407790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:34.416013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c2127395-9bbc-4c08-b606-16f0bcf08bc2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.197660 Aug 22 16:08:34.416701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 465/942] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:35.437358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:35.438032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:35.440303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:35.445830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:35.446319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:35.446754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:35.447493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:35.447958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:35.448391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:35.579523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:35.587411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d2d81362-b2cb-4547-9c02-2274bb95280f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.154064 Aug 22 16:08:35.587978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 478/943] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:35.759865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a877d684-0c55-4492-92ca-f5e5248fdd54", "device": "/dev/sdb"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:35.762836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:35.764742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:35.765716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:35.772674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:35.773174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:35.773609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:35.774310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:35.774765 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:35.775193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:36.144670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-417731ae-dd0e-42e9-8d12-19f253ce9a6c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "POST /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388678 Aug 22 16:08:36.145291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 466/944] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:08:35 2022] POST /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:36.608551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:36.609129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:36.619017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:36.619766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:36.620212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:36.621601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:36.622068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:36.622499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:36.758152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:36.766090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-347dd9cf-9cbe-44d3-b32e-104d3faf0d96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.161458 Aug 22 16:08:36.766665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 479/945] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:37.788132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:37.788848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:37.795718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:37.796132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:37.796566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:37.797286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:37.797736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:37.798161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:37.930130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:37.937736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9d1dc2bb-b514-4d87-911a-6c66a911dda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.154366 Aug 22 16:08:37.938287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 467/946] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:38.958766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:38.959498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:38.966114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:38.966608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:38.967048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:38.967808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:38.968269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:38.968726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:39.103148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:39.110913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9ad09a0c-d46c-4460-ac3a-7c1fb1c83ffe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.156058 Aug 22 16:08:39.111511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 480/947] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:40.132613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:40.133174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:40.139523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:40.140016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:40.140423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:40.141108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:40.141551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:40.141998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:40.272113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:40.279630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eb4af512-a7b3-4079-9243-70fa2bb7c0bc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.151400 Aug 22 16:08:40.280221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 468/948] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:41.107411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-f21cfba6-9c11-4d69-acc0-4802e2097f7e req-2d5a8057-b700-4ba3-bd1e-7ac85a69a9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a2bdd7-2790-42d9-914e-4dab6caaec39", "name": "network-vif-plugged", "status": "completed", "tag": "2af7b377-5d28-4879-ae25-955d593fbddf"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:41.117636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-f21cfba6-9c11-4d69-acc0-4802e2097f7e req-2d5a8057-b700-4ba3-bd1e-7ac85a69a9e3 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:41.118126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-f21cfba6-9c11-4d69-acc0-4802e2097f7e req-2d5a8057-b700-4ba3-bd1e-7ac85a69a9e3 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:41.118552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-f21cfba6-9c11-4d69-acc0-4802e2097f7e req-2d5a8057-b700-4ba3-bd1e-7ac85a69a9e3 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:41.131144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-f21cfba6-9c11-4d69-acc0-4802e2097f7e req-2d5a8057-b700-4ba3-bd1e-7ac85a69a9e3 service nova] Creating event network-vif-plugged:2af7b377-5d28-4879-ae25-955d593fbddf for instance 11a2bdd7-2790-42d9-914e-4dab6caaec39 on hv-cinder-85400 Aug 22 16:08:41.137435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-f21cfba6-9c11-4d69-acc0-4802e2097f7e req-2d5a8057-b700-4ba3-bd1e-7ac85a69a9e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033755 Aug 22 16:08:41.138396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 481/949] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:41.300228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:41.300840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:41.307683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:41.308200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:41.308612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:41.309311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:41.309767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:41.310197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:41.441119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:41.449479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-39d84dea-f67b-45fd-acb1-2b1acd821eea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.153067 Aug 22 16:08:41.450049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 469/950] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:42.471629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:42.472335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:42.479631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:42.480113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:42.480550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:42.481244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:42.481702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:42.482130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:42.620965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:42.628515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f7ffdbb7-987c-4da8-bbe2-713ca0aac4dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1359 microversion: 2.1 time: 0.161135 Aug 22 16:08:42.629072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 482/951] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:43.651310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:43.652080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:43.659109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:43.659635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:43.660094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:43.660828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:43.661836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:43.662324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:43.791998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:43.799656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f21d1030-64ce-436a-9e2f-dd412ed9d45e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1549 microversion: 2.1 time: 0.154932 Aug 22 16:08:43.800219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 470/952] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:43.820427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:43.821045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:43.827176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:43.827691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:43.828131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:43.828825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:43.829283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:43.829709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:43.962446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:43.970872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-14c69c2e-bc72-4409-96bb-a6c7aa1c9b95 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1549 microversion: 2.1 time: 0.154239 Aug 22 16:08:43.971453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 483/953] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:43.990855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:43.995658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:43.996433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Searching by: {'deleted': False, 'project_id': 'd3f48363627d49948f567e5dd81e873a'} {{(pid=121080) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 16:08:44.003079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:44.003601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:44.004038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:44.004768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:44.005267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:44.005694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:44.097624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.multi_cell_list [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121080) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 16:08:44.345707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-73fff80d-0649-42b2-bc03-0fa902f0fcb6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.358593 Aug 22 16:08:44.346195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 471/954] 10.222.0.40 () {58 vars in 1125 bytes} [Mon Aug 22 16:08:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:44.358786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:44.359751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:44.368085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:44.368655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:44.369146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:44.370076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:44.370669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:44.371146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:44.501408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:44.509364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-15090b2d-dc35-42ed-b1e2-c165176dffdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1549 microversion: 2.1 time: 0.155276 Aug 22 16:08:44.509931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 484/955] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:46.058117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:46.060523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:46.067053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:46.067613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:46.068051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:46.068747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:46.069204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:46.069638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:47.030125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:47.030646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:47.037243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:47.037722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:47.038172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:47.038851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:47.039302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:47.039762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:47.065637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:08:47.144882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f652b579-7f0e-4ad7-ad76-fc8837757efd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 204 len: 0 microversion: 2.1 time: 0.118526 Aug 22 16:08:47.145513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 485/956] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:08:47 2022] DELETE /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 16:08:47.151318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-cff9cf6c-18d2-444f-b6b9-976066f10646 req-0e617849-51ee-4000-afb8-8e0ad59a1644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d36279b-140d-4f9c-bd43-609a981d98d5", "tag": "f1a99de3-868a-4e9d-9f7c-167a63d748ad"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:47.162024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-cff9cf6c-18d2-444f-b6b9-976066f10646 req-0e617849-51ee-4000-afb8-8e0ad59a1644 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:47.162498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-cff9cf6c-18d2-444f-b6b9-976066f10646 req-0e617849-51ee-4000-afb8-8e0ad59a1644 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:47.162923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-cff9cf6c-18d2-444f-b6b9-976066f10646 req-0e617849-51ee-4000-afb8-8e0ad59a1644 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:47.174192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-cff9cf6c-18d2-444f-b6b9-976066f10646 req-0e617849-51ee-4000-afb8-8e0ad59a1644 service nova] Creating event network-changed:f1a99de3-868a-4e9d-9f7c-167a63d748ad for instance 9d36279b-140d-4f9c-bd43-609a981d98d5 on hv-cinder-85400 Aug 22 16:08:47.179477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-cff9cf6c-18d2-444f-b6b9-976066f10646 req-0e617849-51ee-4000-afb8-8e0ad59a1644 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032340 Aug 22 16:08:47.180061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 486/957] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:47.185110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:47.185801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:47.191755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:47.192231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:47.193272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:47.193957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:47.194405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:47.194821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:47.336708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:47.344906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bb957ecf-c776-4b58-a268-8a2b93493ffd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1577 microversion: 2.1 time: 0.163625 Aug 22 16:08:47.345497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 487/958] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:47 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:48.366525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:48.367192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:48.373498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:48.373984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:48.374423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:48.375120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:48.375610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:48.376040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:48.508537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:48.516514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-43ff486d-7a42-454b-a52d-30c52b9680af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1577 microversion: 2.1 time: 0.153967 Aug 22 16:08:48.517080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 488/959] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:48 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:49.537914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:49.538599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:49.545172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:49.545645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:49.546072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:49.546757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:49.547204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:49.547652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:49.680326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:49.688249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-51607680-7273-46e5-8f19-626be6c8b4ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1577 microversion: 2.1 time: 0.154724 Aug 22 16:08:49.688812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 489/960] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:49 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:50.452337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2a2af9eb-4585-4070-8dee-db88cc4445fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.397998 Aug 22 16:08:50.453098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 472/961] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Aug 22 16:08:46 2022] POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 194 bytes in 4400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:50.709364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:50.709980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:50.716750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:50.717238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:50.717677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:50.718387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:50.718877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:50.719303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:50.854961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:50.862611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7df484ec-4a0e-478e-bcb2-720748b3483f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1577 microversion: 2.1 time: 0.157169 Aug 22 16:08:50.863167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 490/962] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:50 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:51.885152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:51.885849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:51.892696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:51.893183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:51.893711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:51.894330 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:51.895261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:51.895716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:52.026433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:52.034484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-939d93ce-d5db-4d92-88c3-1ba6cc79ec00 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1577 microversion: 2.1 time: 0.154011 Aug 22 16:08:52.035048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 473/963] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:51 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:53.057283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:53.057829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:53.064414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:53.064923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:53.065354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:53.066054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:53.066506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:53.066931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:53.086396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:53.210556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:53.218739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5bd9ab5a-34cd-4bb3-9513-8db913501747 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1577 microversion: 2.1 time: 0.165398 Aug 22 16:08:53.219301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 491/964] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:53 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:08:53.802772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-98b39498-1cfa-4d73-b055-b2877d3ddf09 req-2f4e878b-2188-4737-92b5-490332bb3f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d36279b-140d-4f9c-bd43-609a981d98d5", "name": "network-vif-unplugged", "status": "completed", "tag": "f1a99de3-868a-4e9d-9f7c-167a63d748ad"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:53.813800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-98b39498-1cfa-4d73-b055-b2877d3ddf09 req-2f4e878b-2188-4737-92b5-490332bb3f2d service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:53.814609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-98b39498-1cfa-4d73-b055-b2877d3ddf09 req-2f4e878b-2188-4737-92b5-490332bb3f2d service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:53.815391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-98b39498-1cfa-4d73-b055-b2877d3ddf09 req-2f4e878b-2188-4737-92b5-490332bb3f2d service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:53.829866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-98b39498-1cfa-4d73-b055-b2877d3ddf09 req-2f4e878b-2188-4737-92b5-490332bb3f2d service nova] Creating event network-vif-unplugged:f1a99de3-868a-4e9d-9f7c-167a63d748ad for instance 9d36279b-140d-4f9c-bd43-609a981d98d5 on hv-cinder-85400 Aug 22 16:08:53.835735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-98b39498-1cfa-4d73-b055-b2877d3ddf09 req-2f4e878b-2188-4737-92b5-490332bb3f2d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036860 Aug 22 16:08:53.837336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 474/965] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:54.241399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:54.241939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:54.249025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:54.249516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:54.249978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:54.250689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:54.251143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:54.251617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:54.403801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:54.414099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-72f894bc-144b-4540-a6bb-57573bd345cc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1458 microversion: 2.1 time: 0.177018 Aug 22 16:08:54.415032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 492/966] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:54 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1458 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:54.752500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-870feea9-ef05-4e05-a376-612dd1506d0d req-43f56fb0-f762-40a7-a58d-d322d320e72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d36279b-140d-4f9c-bd43-609a981d98d5", "name": "network-vif-deleted", "tag": "f1a99de3-868a-4e9d-9f7c-167a63d748ad"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:08:54.758172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:54.766145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-870feea9-ef05-4e05-a376-612dd1506d0d req-43f56fb0-f762-40a7-a58d-d322d320e72d service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:54.766629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-870feea9-ef05-4e05-a376-612dd1506d0d req-43f56fb0-f762-40a7-a58d-d322d320e72d service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:54.767075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-870feea9-ef05-4e05-a376-612dd1506d0d req-43f56fb0-f762-40a7-a58d-d322d320e72d service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:54.770179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:54.780457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-870feea9-ef05-4e05-a376-612dd1506d0d req-43f56fb0-f762-40a7-a58d-d322d320e72d service nova] Creating event network-vif-deleted:f1a99de3-868a-4e9d-9f7c-167a63d748ad for instance 9d36279b-140d-4f9c-bd43-609a981d98d5 on hv-cinder-85400 Aug 22 16:08:54.785648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-870feea9-ef05-4e05-a376-612dd1506d0d req-43f56fb0-f762-40a7-a58d-d322d320e72d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037031 Aug 22 16:08:54.786263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 475/967] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:08:55.436530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:55.437055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:55.444135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:55.444613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:55.445042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:55.445727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:55.446181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:55.446595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:55.508839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:55.516584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0adea2f6-11fa-414d-a52d-62e93f9f6aff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084170 Aug 22 16:08:55.517135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 493/968] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:55 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:56.538840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:56.539557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:56.546482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:56.546959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:56.547415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:56.548106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:56.548553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:56.548969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:56.616740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:56.624676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2dc7c570-1b70-44ab-820f-b43ee51ad309 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091376 Aug 22 16:08:56.625249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 476/969] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:56 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:57.647941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:57.648670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:57.655226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:57.655753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:57.656193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:57.656901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:57.657365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:57.657790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:57.722798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:57.731277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-de966e77-b851-4df2-8232-9bf8df1561eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089871 Aug 22 16:08:57.731872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 494/970] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:57 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:08:58.752624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:08:58.753266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:08:58.760364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:58.760866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:58.761280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:58.761966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:08:58.762411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:08:58.762828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:08:58.977977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:08:58.985795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1329017d-1281-4421-830b-196ef9ec737e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.237181 Aug 22 16:08:58.986343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 477/971] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:08:58 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:00.006499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:00.007120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:00.013916 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:00.014410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:00.014851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:00.015575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:00.016036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:00.016463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:00.077213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:00.085500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-35b21d36-ded7-433b-aab5-e1d1ec302753 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083421 Aug 22 16:09:00.086056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 495/972] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:00 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:01.106744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:01.107370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:01.113904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:01.114393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:01.114832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:01.116383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:01.116659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:01.117087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:01.180625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:01.188330 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9efb8d62-963e-48e1-bddf-8ea9f2d8a003 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085471 Aug 22 16:09:01.188925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 478/973] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:01 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:09:02.208350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:02.209539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:02.212572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:02.218131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:02.218619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:02.219058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:02.219822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:02.220283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:02.220709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:02.338492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:02.346329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-449e6082-c04d-483c-81f6-7acc4ecb331d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.142020 Aug 22 16:09:02.346911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 496/974] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:02 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:02.876326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:09:02.876905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:09:03.368093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:03.368618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:03.370918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=30 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:03.376813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:03.377295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:03.377731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:03.378422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:03.378867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:03.379286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:03.440868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:03.449253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f51700f0-825d-45a1-9149-03a2623bec79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085661 Aug 22 16:09:03.449809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 479/975] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:03 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:04.470177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:04.470723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:04.477274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:04.477761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:04.478216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:04.478895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:04.479374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:04.479806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:04.541073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:04.548876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ff174d9b-612d-47a1-9e5f-6c38c502a2de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082802 Aug 22 16:09:04.549430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 497/976] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:04 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:05.569550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:05.570150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:05.576540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:05.577014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:05.577441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:05.578121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:05.578570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:05.578992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:05.643492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:05.651905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ae6b53aa-83e6-41d1-82ec-c8eb316a0948 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086181 Aug 22 16:09:05.652458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 480/977] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:05 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:06.672804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:06.673353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:06.679806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:06.680281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:06.680722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:06.681499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:06.681987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:06.682411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:06.744027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:06.752686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b1638df-b8a5-443a-8da4-a14d338df6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083799 Aug 22 16:09:06.753255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 498/978] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:06 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:07.774135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:07.780988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:07.782813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:07.783311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:07.783775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:07.784485 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:07.784939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:07.785367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:07.847109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:07.854940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7d033640-1178-4e44-beed-aaa92f0ff4b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084834 Aug 22 16:09:07.855523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 481/979] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:07 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:08.875441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:08.876054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:08.882611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:08.883097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:08.883566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:08.884918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:08.885376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:08.885832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:08.949632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:08.957618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9318dcd1-002a-4dc8-a3ab-0d22eed27749 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086087 Aug 22 16:09:08.958199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 499/980] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:08 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:09.979702 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:09.980345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:09.987567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:09.988052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:09.988486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:09.989184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:09.989640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:09.990066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:10.057564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:10.065071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-34b8181b-972b-4d60-8897-24a4a863ba88 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089976 Aug 22 16:09:10.065627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 482/981] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:09 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:11.085552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:11.086163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:11.092810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:11.093291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:11.093723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:11.094419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:11.094875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:11.095301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:11.156233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:11.163871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cc25749f-e843-42cb-abdc-0f8d181ae654 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082208 Aug 22 16:09:11.164438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 500/982] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:11 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:12.185932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:12.186498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:12.192834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:12.193316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:12.193749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:12.194442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:12.194948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:12.195355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:12.256263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:12.263910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d99c8605-e321-4be7-81fd-f5f166b91e39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.081880 Aug 22 16:09:12.264480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 483/983] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:12 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:09:13.285226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:13.285883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:13.292378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:13.292865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:13.293304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:13.294000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:13.294489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:13.294918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:13.356552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:13.364426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-58518f84-30c0-44a7-9124-ef15b8d41d57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083065 Aug 22 16:09:13.364989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 501/984] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:13 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:14.386164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:14.386767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:14.393387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:14.393869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:14.394307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:14.395002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:14.395498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:14.395928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:14.460903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:14.469361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0721b3e4-2cfa-4087-950d-75a361a7b713 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087679 Aug 22 16:09:14.469925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 484/985] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:14 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:15.490597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:15.491235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:15.497594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:15.498078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:15.498515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:15.499206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:15.499701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:15.500129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:15.561774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:15.569490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-17e1276c-f896-4a2c-b72d-4eed9688512e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082875 Aug 22 16:09:15.570044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 502/986] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:15 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:16.590848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:16.591485 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:16.598110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:16.598603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:16.599035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:16.599805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:16.600259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:16.600679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:16.662689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:16.670924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7ed3893f-21f1-41c4-8264-c90b33423200 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084194 Aug 22 16:09:16.671525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 485/987] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:16 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:17.691922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:17.692572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:17.699019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:17.699531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:17.699968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:17.700661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:17.701117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:17.701541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:17.763299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:17.771084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c643af8c-11f5-4f1d-b3e8-0641cdec8a41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083052 Aug 22 16:09:17.771691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 503/988] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:17 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:18.792245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:18.792772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:18.799154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:18.799662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:18.800097 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:18.800786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:18.801238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:18.801661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:18.866429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:18.874214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1f290e05-3853-49a1-b1b5-97a7624c28a2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085932 Aug 22 16:09:18.874774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 486/989] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:18 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:19.895249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:19.895896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:19.902870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:19.903369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:19.903798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:19.904485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:19.905863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:19.905863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:19.969576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:19.977122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b20c409e-730e-48c4-83dd-e84582809974 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085750 Aug 22 16:09:19.978328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 504/990] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:19 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:20.998621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:20.999348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:21.005588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:21.006061 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:21.006487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:21.007203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:21.007641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:21.008057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:21.068033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:21.075608 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0ce6a539-d65f-46ad-84a1-c0ff0b87f141 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.081403 Aug 22 16:09:21.076156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 487/991] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:20 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:22.096339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:22.096988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:22.103541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:22.104026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:22.104463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:22.105154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:22.105611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:22.106034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:22.167503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:22.177214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7678cb3d-d6df-4764-9eb4-ba3b463aa39b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084663 Aug 22 16:09:22.177786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 505/992] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:22 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:23.197779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:23.198412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:23.204870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:23.205356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:23.205795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:23.206495 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:23.206951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:23.207471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:23.274523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:23.282588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0b686f62-c710-48fd-a652-b152613b0b3f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088688 Aug 22 16:09:23.283225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 488/993] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:23 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:24.303515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:24.304132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:24.310954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:24.311565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:24.312005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:24.312712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:24.313176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:24.313702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:24.317718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=87 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:24.381048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:24.389915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7abfde96-79de-415b-be92-96827abfdde1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089531 Aug 22 16:09:24.389915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 506/994] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:24 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:25.409462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:25.410068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:25.416569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:25.417008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:25.417444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:25.418131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:25.418579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:25.419104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:25.481294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:25.489016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-77e3d0fc-fb8e-4909-9d10-df4304efd70a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083408 Aug 22 16:09:25.489573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 489/995] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:25 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:26.508700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:26.509442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:26.516190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:26.516680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:26.517123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:26.517828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:26.518314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:26.518717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:26.580657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:26.588956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-72f3e744-12b6-4376-a47d-0f3913125a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083993 Aug 22 16:09:26.589948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 507/996] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:26 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:27.611784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:27.612394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:27.618753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:27.619235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:27.619721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:27.620435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:27.620890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:27.621320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:27.624573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=86 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:27.687863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:27.695660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b8a5690d-a736-4db0-8a27-8679212b9a33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087689 Aug 22 16:09:27.696228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 490/997] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:27 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:28.716737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:28.717408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:28.723823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:28.724324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:28.724823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:28.725568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:28.726063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:28.726580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:28.788635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:28.797269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cc3437a5-e443-4bd4-8e45-8900563410de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085285 Aug 22 16:09:28.797837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 508/998] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:28 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:29.817825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:29.818442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:29.824899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:29.825374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:29.826329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:29.827015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:29.827502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:29.827929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:29.889131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:29.896714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8015cf8d-690b-47a6-b417-e9570f6ea571 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082761 Aug 22 16:09:29.897277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 491/999] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:29 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:30.917566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:30.918168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:30.925197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:30.925725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:30.926248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:30.926941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:30.927423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:30.927869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:30.989890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:30.997610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3b7dd9f4-06c4-49e5-a438-b7d04df34cf0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083874 Aug 22 16:09:30.998169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 509/1000] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:30 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:32.018673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:32.019302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:32.025761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:32.026248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:32.026687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:32.027412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:32.027871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:32.028299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:32.091715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:32.099434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c0b9d29e-8548-4b1e-9225-ee263f9f8df5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084595 Aug 22 16:09:32.099997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 492/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:32 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:33.120441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:33.121064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:33.123484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=28 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:33.129233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:33.129743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:33.130181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:33.130884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:33.131369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:33.131806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:33.205151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:33.213317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8983d1cf-9710-44dc-bd24-44b2459e6f7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.096440 Aug 22 16:09:33.213901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 510/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:33 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:34.234575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:34.235188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:34.237516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=28 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:34.243013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:34.243528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:34.243996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:34.244693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:34.245140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:34.245564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:34.307583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:34.315951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6f06e16f-9acd-411f-b3f9-2be7ac56624c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085919 Aug 22 16:09:34.316523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 493/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:34 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:09:35.337920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:35.338532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:35.345202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:35.346335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:35.346776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:35.347519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:35.347977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:35.348405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:35.410896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:35.419036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3455ef0b-dc19-49f4-a1ea-73252750af99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085417 Aug 22 16:09:35.420137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 511/1004] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:35 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:36.442541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:36.443226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:36.449692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:36.450174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:36.451225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:36.451954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:36.452409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:36.452838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:36.517673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:36.525794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-49fa252c-144e-4a00-8b54-802849ef4a70 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087137 Aug 22 16:09:36.526364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 494/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:36 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:37.546503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:37.547116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:37.553627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:37.554112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:37.554542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:37.555236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:37.555719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:37.556143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:37.619319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:37.627149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-485739fe-c622-4380-b3fa-032f10a7382e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084695 Aug 22 16:09:37.627733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 512/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:37 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:38.650704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:38.651462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:38.658222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:38.658698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:38.659124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:38.659848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:38.660294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:38.660710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:38.725525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:38.733247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-68449f3c-286f-403a-b5ff-7e40c873cdc1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086869 Aug 22 16:09:38.733806 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 495/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:38 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:39.753934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:39.754537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:39.761078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:39.761568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:39.762011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:39.762715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:39.763719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:39.764158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:39.830137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:39.839392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9a7d5414-2400-44e6-aa2b-1415261b54dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089125 Aug 22 16:09:39.840396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 513/1008] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:39 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:40.864326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:40.865418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:40.877210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:40.878069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:40.878835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:40.880078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:40.880872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:40.881551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:40.978026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:40.986716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4852202f-3a5a-4366-af9e-a81221bf1c5e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.128290 Aug 22 16:09:40.987366 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 496/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:40 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:42.008236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:42.008849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:42.016356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:42.016834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:42.017268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:42.017954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:42.018403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:42.018820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:42.081092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:42.089111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-69a18d2e-f043-4a0b-b5f2-56b0cbc2fb8b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084888 Aug 22 16:09:42.089675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 514/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:42 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:43.111233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:43.111873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:43.118539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:43.119109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:43.119581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:43.120280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:43.120731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:43.121156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:43.183882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:43.192195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e2b0f905-62fa-4a5f-8ca3-322bf9ea66fc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085647 Aug 22 16:09:43.192755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 497/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:43 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:44.214138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:44.214693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:44.221482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:44.221996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:44.222432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:44.223127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:44.223633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:44.224056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:44.284941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:44.292718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5936c630-e93b-4535-ba41-26077bd06b0f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083018 Aug 22 16:09:44.293278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 515/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:44 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:45.320839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:45.321931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:45.333572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:45.334409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:45.335142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:45.336366 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:45.337145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:45.337880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:45.407541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:45.417844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ab172304-9484-4e4f-9f89-74ef38b56908 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.104068 Aug 22 16:09:45.418403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 498/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:45 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:46.439050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:46.440079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:46.446342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:46.446818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:46.447258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:46.447973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:46.448453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:46.448847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:46.520344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:46.534319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-234c7acc-d8fc-468e-b29e-3109a6c31e7a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.099489 Aug 22 16:09:46.535438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 516/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:46 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:47.556241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:47.556906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:47.562968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:47.563482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:47.563911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:47.564625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:47.565940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:47.566621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:47.633279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:47.640197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-021d1ed8-adb1-47ff-8241-92e692332391 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087716 Aug 22 16:09:47.640769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 499/1015] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:47 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:48.661851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:48.662472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:48.669746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:48.669975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:48.670411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:48.671100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:48.671585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:48.672008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:48.735994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:48.746883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e36c670-94bc-446c-aaae-667e9be8ffaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088530 Aug 22 16:09:48.748372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 517/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:48 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:49.772974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:49.776154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:49.784024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:49.784772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:49.785488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:49.786634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:49.787363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:49.788035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:49.897026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:49.910080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c812051f-daab-4f2f-8554-f720bdf662b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.143441 Aug 22 16:09:49.911021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 500/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:49 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:50.940769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:50.942043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:50.949494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:50.950917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:50.952050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:50.952782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:50.953253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:50.954107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:51.024346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:51.033931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f6d3d9d6-4976-47f7-90a3-55219e16a7a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.097226 Aug 22 16:09:51.034514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 518/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:50 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:52.054314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:52.055236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:52.063497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:52.064032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:52.064507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:52.065405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:52.065855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:52.066288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:52.173219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:52.178423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:52.179234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:52.183605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-614b6fb4-a590-4a33-8309-611c31963069 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.133150 Aug 22 16:09:52.184342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 501/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:52 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:52.187536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:52.188175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:52.188691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:52.189497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:52.190063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:52.190556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:52.354786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:52.368563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b902bc42-7492-4135-836d-07bcf731d17b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1595 microversion: 2.1 time: 0.193696 Aug 22 16:09:52.369619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 519/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1595 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:53.208341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:53.209342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:53.218370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:53.218930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:53.219520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:53.220436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:53.221070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:53.221617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:53.413335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:53.421598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57f81b6e-58fd-4fc9-ad28-96e90467de79 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.217333 Aug 22 16:09:53.422178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 502/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:53 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:54.451702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:54.453053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:54.460186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:54.460721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:54.461153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:54.461857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:54.462310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:54.462730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:54.466481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=84 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:54.520383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-3c06f836-2053-4892-b5e4-83f7ee6057ab req-392e94e5-0e8a-4ad8-9841-0976c139f9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a2bdd7-2790-42d9-914e-4dab6caaec39", "tag": "2af7b377-5d28-4879-ae25-955d593fbddf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:09:54.545725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3c06f836-2053-4892-b5e4-83f7ee6057ab req-392e94e5-0e8a-4ad8-9841-0976c139f9b0 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:54.547715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3c06f836-2053-4892-b5e4-83f7ee6057ab req-392e94e5-0e8a-4ad8-9841-0976c139f9b0 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:54.548620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3c06f836-2053-4892-b5e4-83f7ee6057ab req-392e94e5-0e8a-4ad8-9841-0976c139f9b0 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:54.561514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:54.570014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f586b3a8-1ee6-4593-ae24-fe9774be1c91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.122410 Aug 22 16:09:54.570616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 520/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:54 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:09:54.577443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-3c06f836-2053-4892-b5e4-83f7ee6057ab req-392e94e5-0e8a-4ad8-9841-0976c139f9b0 service nova] Creating event network-changed:2af7b377-5d28-4879-ae25-955d593fbddf for instance 11a2bdd7-2790-42d9-914e-4dab6caaec39 on hv-cinder-85400 Aug 22 16:09:54.598554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-3c06f836-2053-4892-b5e4-83f7ee6057ab req-392e94e5-0e8a-4ad8-9841-0976c139f9b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085805 Aug 22 16:09:54.599298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 503/1023] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:09:55.610250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:55.611179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:55.619986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:55.620870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:55.621521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:55.623487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:55.624415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:55.625085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:55.723110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:55.734094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e265aac-ead8-4a92-b45f-5308db658790 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.132321 Aug 22 16:09:55.735510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 521/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:55 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:56.065394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1856232759"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:09:56.066054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:56.072604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:56.073078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:56.073502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:56.074377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:56.074822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:56.075772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:56.213720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.network.security_group_api [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Adding security group 0b146d22-ce8b-477e-8cc9-796cd392487c to port 2af7b377-5d28-4879-ae25-955d593fbddf Aug 22 16:09:56.574427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-89533581-8073-4534-99c4-fabb0cd5798b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/action" status: 202 len: 0 microversion: 2.1 time: 0.514732 Aug 22 16:09:56.575238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 504/1025] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:09:56 2022] POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:09:56.584683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:56.585313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:56.592066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:56.592580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:56.593108 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:56.593819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:56.594283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:56.594755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:56.627430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-0dd3a580-980e-4bfd-b224-9546e34140ad req-8e68a5bc-2d4d-432e-a501-f856900e8291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a2bdd7-2790-42d9-914e-4dab6caaec39", "tag": "2af7b377-5d28-4879-ae25-955d593fbddf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:09:56.654379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0dd3a580-980e-4bfd-b224-9546e34140ad req-8e68a5bc-2d4d-432e-a501-f856900e8291 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:56.656745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0dd3a580-980e-4bfd-b224-9546e34140ad req-8e68a5bc-2d4d-432e-a501-f856900e8291 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:56.657515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0dd3a580-980e-4bfd-b224-9546e34140ad req-8e68a5bc-2d4d-432e-a501-f856900e8291 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:56.673251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-0dd3a580-980e-4bfd-b224-9546e34140ad req-8e68a5bc-2d4d-432e-a501-f856900e8291 service nova] Creating event network-changed:2af7b377-5d28-4879-ae25-955d593fbddf for instance 11a2bdd7-2790-42d9-914e-4dab6caaec39 on hv-cinder-85400 Aug 22 16:09:56.679101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-0dd3a580-980e-4bfd-b224-9546e34140ad req-8e68a5bc-2d4d-432e-a501-f856900e8291 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064450 Aug 22 16:09:56.680216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 505/1026] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:09:56.760096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:56.761274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:56.773574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:56.774561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:56.775444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:56.777340 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:56.778495 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:56.779496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:56.880159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:56.898785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b58b019f-b0da-476e-a189-66042cfb59d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1760 microversion: 2.1 time: 0.317932 Aug 22 16:09:56.900726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 522/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1760 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:56.930959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:56.946241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b0562d0a-fd0c-4d2e-b381-0b25bc68d538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.194582 Aug 22 16:09:56.949061 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 506/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:56 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:57.988293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:57.989424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:58.001177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:58.002035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:58.002821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:58.004115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:58.004953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:58.005729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:58.082323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:58.091395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eacaf605-c220-4587-a946-038b117753cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.110377 Aug 22 16:09:58.092079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 523/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:57 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:58.175977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:09:58.179205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:58.189705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:58.190452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:58.191101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:58.192206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:58.192887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:58.193528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:58.200883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=92 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:58.315521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e678fb47-b6ff-4594-bff6-86b1fa857cfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/action" status: 202 len: 0 microversion: 2.1 time: 0.145412 Aug 22 16:09:58.316492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 507/1030] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:09:58 2022] POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 16:09:58.330232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:58.331681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:58.345544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:58.346417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:58.347971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:58.348334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:58.349184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:58.349943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:58.592151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:58.602883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-775022bd-0fd0-4942-9e3b-d72cc7c2ad12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1752 microversion: 2.1 time: 0.279741 Aug 22 16:09:58.603898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 524/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1752 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:59.113274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:59.114142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:59.121860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:59.122471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:59.123000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:59.123879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:59.124382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:59.125230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:59.210414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:59.220222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c72f4f7c-5005-4c03-9e9d-56d0f37ccba2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.111317 Aug 22 16:09:59.220959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 508/1032] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:59 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:09:59.628288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:09:59.629054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:09:59.636048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:59.636538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:59.636981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:59.637731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:09:59.638169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:09:59.638602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:09:59.836142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:09:59.852115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6594acdd-3d34-454e-bc77-83d51cf3958c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.228107 Aug 22 16:09:59.853117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 525/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:09:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:00.247910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:00.248920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:00.260273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:00.260900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:00.261429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:00.262488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:00.263736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:00.264395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:00.365171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:00.374045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a572d543-d3cd-4607-8eb3-8065f4657452 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.134279 Aug 22 16:10:00.374723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 509/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:00 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:00.885404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:00.886316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:00.894606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:00.895350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:00.896040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:00.897113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:00.897820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:00.898455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:01.084020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:01.094700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-85848c81-6b67-47fc-908d-db78f1e6e215 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.214880 Aug 22 16:10:01.095451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 526/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:01.398980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:01.400131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:01.411278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:01.411834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:01.412374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:01.413131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:01.413741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:01.414207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:01.491809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:01.502216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f394bb77-82bb-435c-aec9-86e1ff62c38b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.109576 Aug 22 16:10:01.503083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 510/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:01 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:02.120898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:02.121541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:02.128297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:02.128785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:02.129224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:02.129930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:02.130395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:02.130822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:02.291695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:02.300331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c16cb848-c846-4dde-97c6-068d809b28d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.183452 Aug 22 16:10:02.300915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 527/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:02.523932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:02.524577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:02.532002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:02.532484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:02.532932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:02.533633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:02.534094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:02.534519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:02.602769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:02.611773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a97b745e-6735-4b6d-931b-d8027f2acc57 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091502 Aug 22 16:10:02.612350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 511/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:02 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:03.323053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:03.323853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:03.326693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=36 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:03.333343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:03.333852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:03.334336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:03.335181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:03.335657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:03.336129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:03.509046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:03.519495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0f9299b2-2366-4781-afb0-0c9790130fcb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.201059 Aug 22 16:10:03.520082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 528/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:03.633127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:03.633715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:03.640346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:03.640833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:03.641296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:03.642030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:03.642485 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:03.642940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:03.710828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:03.720708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9b663ea0-bc2d-49e3-9c59-9d4cb007d433 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.092082 Aug 22 16:10:03.721295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 512/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:03 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:04.542992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:04.544290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:04.551671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:04.551914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:04.552376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:04.553243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:04.553679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:04.554110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:04.725808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:04.738890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0fc3a5a3-e2aa-4e89-a5d3-5f99604496d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.200471 Aug 22 16:10:04.739909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 529/1041] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:04.745155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:04.746804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:04.752779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=40 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:04.760029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:04.760905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:04.761687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:04.763012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:04.763870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:04.764644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:04.833874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:04.848733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b7b294ce-c7b9-494c-ad44-107e9c9c3deb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.109619 Aug 22 16:10:04.850031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 513/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:04 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:05.774685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:05.775350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:05.781776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:05.782313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:05.782856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:05.783653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:05.784168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:05.784692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:05.879822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:05.880591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:05.887421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:05.887955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:05.888397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:05.889104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:05.889563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:05.889984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:05.952268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:05.961822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-67286059-1a51-484d-a7c2-996bb3fa1953 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.191478 Aug 22 16:10:05.965958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 530/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:05.974205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:05.988224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4ab777de-e6db-4f51-b4fa-3966cf3f0bca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.112359 Aug 22 16:10:05.989072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 514/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:05 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:06.991174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:06.991799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:06.998828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:06.999309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:06.999768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:07.000464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:07.000920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:07.001343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:07.018165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:07.018821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:07.025291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:07.025783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:07.026225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:07.026936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:07.027504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:07.027852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:07.097566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:07.105459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1be398d0-26a4-4121-934b-7b2e06ef6011 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091182 Aug 22 16:10:07.106041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 515/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:07 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:07.177536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:07.186271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-98fce9ae-a1c9-43aa-9b02-f94462ba71ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.198998 Aug 22 16:10:07.186841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 531/1046] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:08.126274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:08.126868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:08.134711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:08.135200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:08.135675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:08.136375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:08.136822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:08.137244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:08.201980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:08.207110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:08.208217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:08.210045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-99238bf6-09de-4748-a470-f2d488983919 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087662 Aug 22 16:10:08.210606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 516/1047] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:08 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:08.214974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:08.215560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:08.216020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:08.216759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:08.217245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:08.217697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:08.365877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:08.374769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6e762c57-24d4-4262-9efb-b13437c94f33 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.171891 Aug 22 16:10:08.375436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 532/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:09.232844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:09.233560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:09.241516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:09.242259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:09.242713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:09.243578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:09.244063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:09.244546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:09.310887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:09.319559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9b1f4ad7-2265-41b1-bd82-88681b7a6ca0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090727 Aug 22 16:10:09.320141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 517/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:09 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:09.396695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:09.397303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:09.406136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:09.406631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:09.407111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:09.407832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:09.408402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:09.408839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:09.564680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:09.573141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bc01c9aa-106b-4a04-a171-140a2f5004bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1757 microversion: 2.1 time: 0.180364 Aug 22 16:10:09.573712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 533/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:10.342973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:10.343603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:10.350332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:10.350821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:10.351260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:10.352059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:10.352498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:10.352956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:10.422441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:10.430747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9d32aaff-217c-4110-bd90-7479dd0dd0fb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.092402 Aug 22 16:10:10.431341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 518/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:10 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:10.596299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:10.597138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:10.603648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:10.604144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:10.604680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:10.605299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:10.605772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:10.606250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:10.766833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:10.776703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a4b02464-a8f7-4937-aa36-0a7c56f6b3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1760 microversion: 2.1 time: 0.186142 Aug 22 16:10:10.777284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 534/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1760 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:11.452119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:11.452683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:11.459305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:11.459810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:11.460236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:11.460924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:11.461367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:11.461784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:11.525835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:11.534041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7b81b473-eba5-4264-a1ae-5c385ebe8071 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086367 Aug 22 16:10:11.534629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 519/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:11 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:12.555827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:12.556458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:12.564174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:12.564664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:12.565110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:12.565821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:12.566278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:12.566732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:12.631533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:12.640180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16f76586-d5ac-4b78-a22e-b74b557c4cdc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088165 Aug 22 16:10:12.640753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 535/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:12 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:13.661618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:13.662230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:13.669550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:13.670066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:13.670501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:13.671207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:13.671694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:13.672127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:13.738283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:13.747251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-37e83eef-fde0-4f1a-95fb-c998a7c1fe09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089402 Aug 22 16:10:13.747860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 520/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:13 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:14.768473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:14.769546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:14.775542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:14.776042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:14.776480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:14.777187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:14.777643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:14.778112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:14.845306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:14.847559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:14.855457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fb95fed6-a21d-4257-9c43-6a5618ad928d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090928 Aug 22 16:10:14.856035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 536/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:14 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:15.876698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:15.877328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:15.883827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:15.884363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:15.884803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:15.885502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:15.885958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:15.886382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:15.949619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:15.958263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e13a2d4f-1561-478a-8a1f-144ba87e49b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085489 Aug 22 16:10:15.958828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 521/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:15 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:16.979641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:16.980250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:16.987004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:16.987532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:16.988053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:16.988805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:16.989252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:16.989980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:17.054564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:17.063235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-73c8aabf-7b5a-4a19-a597-0e6f859317e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087416 Aug 22 16:10:17.063917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 537/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:16 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:18.085313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:18.085965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:18.092949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:18.093443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:18.093882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:18.094599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:18.095058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:18.095523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:18.157441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:18.159798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:18.166934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-83f1c3d6-f4dc-46ce-843d-3ab8f77e1e5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085710 Aug 22 16:10:18.167537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 522/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:18 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:19.188854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:19.189454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:19.195842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:19.196322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:19.196758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:19.197452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:19.197912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:19.198344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:19.266056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:19.273776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b64b6013-a387-4109-9abb-760f99b2cc1f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089565 Aug 22 16:10:19.274314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 538/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:19 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:20.294486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:20.295056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:20.302998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:20.303787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:20.304230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:20.304935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:20.305397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:20.305824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:20.372298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:20.379985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4bf148d7-3e8a-4ded-927f-1f7f9efade54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089484 Aug 22 16:10:20.380548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 523/1061] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:20 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:21.401936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:21.402530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:21.409096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:21.409581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:21.410019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:21.410714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:21.411174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:21.411642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:21.473463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:21.482402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ff7bfdab-b743-45f9-b42f-262737394538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084278 Aug 22 16:10:21.482968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 539/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:21 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:22.503648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:22.504250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:22.510945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:22.511512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:22.511974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:22.513316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:22.513859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:22.514339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:22.579935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:22.587701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-05a5ada2-b588-4b7c-b646-b8ca46a9b766 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087978 Aug 22 16:10:22.588259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 524/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:22 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:23.608615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:23.609213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:23.615880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:23.616373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:23.616807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:23.617518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:23.617966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:23.618646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:23.683539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:23.691443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1007b9fd-2858-42cf-9671-7c9d29bb34e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086679 Aug 22 16:10:23.692016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 540/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:23 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:24.712836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:24.713391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:24.720691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:24.721174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:24.721612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:24.722331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:24.722788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:24.723214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:24.787528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:24.798834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3d040546-9173-4439-847f-dcb7e58952ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089896 Aug 22 16:10:24.799442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 525/1065] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:24 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:25.818928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:25.819571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:25.826570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:25.827053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:25.827525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:25.828229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:25.828690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:25.829117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:25.892461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:25.900192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-68ad47fc-b8cd-4738-bf53-2a09bc411ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085171 Aug 22 16:10:25.900750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 541/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:25 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:26.922116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:26.922710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:26.929104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:26.929588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:26.930035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:26.930725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:26.931182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:26.931640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:26.993369 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:27.001095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0244998f-b3d2-4b24-b8a0-86dbe63c0b96 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083607 Aug 22 16:10:27.001659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 526/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:26 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:28.022656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:28.023270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:28.030289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:28.030771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:28.031209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:28.031924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:28.032382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:28.032806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:28.096264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:28.103914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f6cf68ac-f254-4cc5-9862-717b9b3293a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085265 Aug 22 16:10:28.104479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 542/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:28 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:29.124556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:29.125163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:29.131628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:29.132112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:29.132542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:29.133223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:29.133669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:29.134085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:29.195830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:29.203539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e0c5b8f2-84b8-44e8-91be-a20c3b3f6b8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082780 Aug 22 16:10:29.204086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 527/1069] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:29 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:30.224553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:30.225165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:30.231524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:30.231999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:30.232427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:30.233104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:30.233552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:30.233969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:30.296212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:30.303836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b0004cf5-71fb-4b44-a2f9-451f73a80df4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083210 Aug 22 16:10:30.304399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 543/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:30 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:31.324408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:31.325024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:31.331553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:31.332041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:31.332477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:31.333170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:31.333625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:31.334049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:31.394850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:31.402544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9481d4eb-925c-4209-9eeb-365c255d02dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082054 Aug 22 16:10:31.403855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 528/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:31 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:32.423895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:32.424512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:32.430883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:32.431394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:32.431837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:32.432534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:32.432995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:32.433429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:32.498561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:32.506379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c2402e26-5104-41ed-9fab-d9dfc2f31a9a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086434 Aug 22 16:10:32.506956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 544/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:32 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:33.526205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:33.526819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:33.533323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:33.533820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:33.534256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:33.535014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:33.535520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:33.535956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:33.597757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:33.605519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ac2bee98-62d4-4003-ac7c-2dc652d2d872 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083225 Aug 22 16:10:33.606720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 529/1073] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:33 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:34.628223 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:34.628784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:34.631173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=34 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:34.636474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:34.636947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:34.637414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:34.638110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:34.638555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:34.638964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:34.703385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:34.711262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8cd61714-ea2f-43f7-aa7f-f6702fb15f5c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087168 Aug 22 16:10:34.711848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 545/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:34 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:35.733573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:35.734133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:35.736476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=34 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:35.741781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:35.742253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:35.742681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:35.743394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:35.743841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:35.744257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:35.807243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:35.815596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e4115778-87c6-4700-96af-85a0b83b90b8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086416 Aug 22 16:10:35.816152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 530/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:35 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:36.835774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:36.836385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:36.844012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:36.844494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:36.844927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:36.845624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:36.846079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:36.846494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:36.913613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:36.922094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-26725f45-230e-41a8-ba6d-f8e608a1286c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090194 Aug 22 16:10:36.922654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 546/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:36 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:37.942126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:37.942738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:37.949287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:37.949842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:37.950275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:37.950978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:37.951469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:37.951891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:38.016849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:38.024896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-599a4600-8b71-4d63-8787-55e67a2fcec2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086658 Aug 22 16:10:38.025542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 531/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:37 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:39.047366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:39.048003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:39.054575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:39.055064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:39.055538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:39.056254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:39.056718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:39.057148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:39.121237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:39.129131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ae77a752-bc2d-42bd-b322-10bee74422f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086982 Aug 22 16:10:39.129709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 547/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:39 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:40.150158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:40.150716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:40.157626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:40.158269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:40.158617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:40.159467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:40.159923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:40.160388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:40.224950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:40.233393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c83f5cd9-95c3-4ad6-84d1-323f2663c27a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087289 Aug 22 16:10:40.233965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 532/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:40 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:41.254060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:41.254662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:41.261367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:41.261844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:41.262285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:41.263623 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:41.264074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:41.264522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:41.330680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:41.338570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-64179baa-1002-4008-9091-e168ade64c01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088362 Aug 22 16:10:41.339166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 548/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:41 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:42.359789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:42.360415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:42.366698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:42.367169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:42.367634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:42.368318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:42.368764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:42.369184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:42.430982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:42.438669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a09ed9e5-5a59-42f6-ad3e-258c919a0bcb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082902 Aug 22 16:10:42.439229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 533/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:42 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:43.459008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:43.459625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:43.466106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:43.466584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:43.467017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:43.468303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:43.468756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:43.469179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:43.491644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1856232759"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:10:43.492239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:43.499075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:43.499659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:43.500197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:43.500966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:43.501489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:43.502016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:43.533728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:43.542494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a35f02ff-2dde-44e0-84e6-cae7b6b83d33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087282 Aug 22 16:10:43.543085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 549/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:43 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:43.631092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.network.security_group_api [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Removing security group 0b146d22-ce8b-477e-8cc9-796cd392487c from port 2af7b377-5d28-4879-ae25-955d593fbddf Aug 22 16:10:43.940825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d5bcfd0f-0a5a-4be2-bf20-4ceed33f4189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/action" status: 202 len: 0 microversion: 2.1 time: 0.453083 Aug 22 16:10:43.944443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 534/1083] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:10:43 2022] POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:10:43.953784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-51ba44db-5d20-42a2-ab1a-fe11f3042086 req-6d54c2a4-bc45-4560-9289-adc06848511f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a2bdd7-2790-42d9-914e-4dab6caaec39", "tag": "2af7b377-5d28-4879-ae25-955d593fbddf"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:10:43.971094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-51ba44db-5d20-42a2-ab1a-fe11f3042086 req-6d54c2a4-bc45-4560-9289-adc06848511f service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:43.971719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-51ba44db-5d20-42a2-ab1a-fe11f3042086 req-6d54c2a4-bc45-4560-9289-adc06848511f service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:43.972213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-51ba44db-5d20-42a2-ab1a-fe11f3042086 req-6d54c2a4-bc45-4560-9289-adc06848511f service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:43.985187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-51ba44db-5d20-42a2-ab1a-fe11f3042086 req-6d54c2a4-bc45-4560-9289-adc06848511f service nova] Creating event network-changed:2af7b377-5d28-4879-ae25-955d593fbddf for instance 11a2bdd7-2790-42d9-914e-4dab6caaec39 on hv-cinder-85400 Aug 22 16:10:43.992716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-51ba44db-5d20-42a2-ab1a-fe11f3042086 req-6d54c2a4-bc45-4560-9289-adc06848511f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042573 Aug 22 16:10:43.999820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 550/1084] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:44.564782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:44.565425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:44.572037 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:44.572524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:44.573208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:44.573938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:44.574393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:44.574821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:44.834124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:44.843516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e5b83e93-13ae-4da5-a149-791df1a01628 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.283370 Aug 22 16:10:44.844095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 535/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:44 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:45.331036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:45.331634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:45.337784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:45.338482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:45.338921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:45.339911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:45.340361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:45.340782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:45.344178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=82 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:45.422754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lazy-loading 'services' on Instance uuid 11a2bdd7-2790-42d9-914e-4dab6caaec39 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:10:45.493224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bf053599-4cc5-4a15-88c0-68ec379f6703 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae" status: 202 len: 0 microversion: 2.1 time: 0.167588 Aug 22 16:10:45.493814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 551/1086] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:10:45 2022] DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:10:45.503383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:45.505943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:45.515891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:45.516482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:45.517064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:45.518053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:45.518578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:45.519080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:45.550671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1bb00cff-c772-4e41-b2ff-f394601a0d94 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052181 Aug 22 16:10:45.551241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 536/1087] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:45.865175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:45.865889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:45.872287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:45.872782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:45.873224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:45.874449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:45.874912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:45.875358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:45.943388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:45.951854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f25ad270-5543-4fa1-afc7-d1a2f7c3a970 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090667 Aug 22 16:10:45.952564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 552/1088] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:45 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:46.009836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-3919c48f-2c82-4790-a01f-e434dd8d4ee4 req-b81e95ff-4d85-4ed5-a93d-184c062b4033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a2bdd7-2790-42d9-914e-4dab6caaec39", "tag": "2af7b377-5d28-4879-ae25-955d593fbddf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:10:46.020904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3919c48f-2c82-4790-a01f-e434dd8d4ee4 req-b81e95ff-4d85-4ed5-a93d-184c062b4033 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:46.021489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3919c48f-2c82-4790-a01f-e434dd8d4ee4 req-b81e95ff-4d85-4ed5-a93d-184c062b4033 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:46.021930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-3919c48f-2c82-4790-a01f-e434dd8d4ee4 req-b81e95ff-4d85-4ed5-a93d-184c062b4033 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:46.034445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-3919c48f-2c82-4790-a01f-e434dd8d4ee4 req-b81e95ff-4d85-4ed5-a93d-184c062b4033 service nova] Creating event network-changed:2af7b377-5d28-4879-ae25-955d593fbddf for instance 11a2bdd7-2790-42d9-914e-4dab6caaec39 on hv-cinder-85400 Aug 22 16:10:46.039935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-3919c48f-2c82-4790-a01f-e434dd8d4ee4 req-b81e95ff-4d85-4ed5-a93d-184c062b4033 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033745 Aug 22 16:10:46.040542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 537/1089] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:46.562443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:46.565250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:46.572682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:46.573179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:46.573828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:46.574882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:46.575361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:46.575965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:46.612143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-26b3f081-ec64-40b2-88df-e31d34a2abc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053083 Aug 22 16:10:46.612143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 553/1090] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:46.974263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:46.975006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:46.981596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:46.982088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:46.982531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:46.983237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:46.983717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:46.984146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:47.051215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:47.059104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3b480977-db36-4c39-8f1e-106f6c0b7f78 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089098 Aug 22 16:10:47.059700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 538/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:46 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:47.626194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:47.628428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:47.634947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:47.635470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:47.635911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:47.636615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:47.637105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:47.637535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:47.671104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bf32c424-8770-4d37-bb8f-7100ea48643e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049058 Aug 22 16:10:47.671695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 554/1092] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:48.080302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:48.080961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:48.087755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:48.088255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:48.088699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:48.089690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:48.090156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:48.090582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:48.153406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:48.162453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-79894739-acbb-4ac4-ae5e-515c414be342 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086144 Aug 22 16:10:48.163020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 539/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:48 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:48.683658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:48.685838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:48.692899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:48.693391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:48.693834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:48.694534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:48.694994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:48.695446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:48.725456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7b6296bf-532b-4778-a9ad-c04bdb9401ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045730 Aug 22 16:10:48.726016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 555/1094] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:10:49.185829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:49.187721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:49.194356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:49.194834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:49.195268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:49.195988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:49.196440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:49.196863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:49.211853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:49.265474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:49.273228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-92e6d644-481d-479e-b60d-f5d9b11533fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.094545 Aug 22 16:10:49.273792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 540/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:49 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:49.738335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:49.740541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:49.746956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:49.747479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:49.747918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:49.748616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:49.749069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:49.749496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:49.780021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-854b8846-11cd-4c76-aaec-f72a9cb57191 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Aug 22 16:10:49.781257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 556/1096] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:50.294374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:50.294931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:50.301454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:50.301936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:50.302372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:50.303065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:50.303549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:50.303976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:50.379018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:50.388212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-945f1ce7-28f9-405a-ae4b-c9a361360640 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.097727 Aug 22 16:10:50.388852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 541/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:50 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:50.793114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:50.795279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:50.802288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:50.802762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:50.803193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:50.803902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:50.804353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:50.804773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:50.834580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-438265d5-a5c4-4dd1-8d26-0a8dcb018d4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Aug 22 16:10:50.835156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 557/1098] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:51.410296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:51.410886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:51.417827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:51.418431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:51.418874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:51.419603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:51.420103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:51.420683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:51.482539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:51.490200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2ce74ba7-2b4b-4bea-bc5b-9f10b04145f0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083771 Aug 22 16:10:51.490757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 542/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:51 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:10:51.846862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:51.849026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:51.855459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:51.855962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:51.856395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:51.857073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:51.857519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:51.857934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:51.886541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-74f2fb58-3b90-415d-b752-89ee5f5bbc4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Aug 22 16:10:51.887113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 558/1100] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:52.142719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:10:52.142934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:10:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:10:52.511247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:52.511788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:52.518318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:52.518804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:52.519239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:52.520022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:52.520480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:52.520903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:52.583850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:52.592064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8eb194e5-df41-499d-be20-e55c06958116 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084856 Aug 22 16:10:52.592624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 543/1101] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:52 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:52.899583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:52.901771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:52.908970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:52.909452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:52.909890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:52.910615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:52.911076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:52.911534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:52.941672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bc2110f9-ff88-4bd2-a93b-55a6d543a4f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046126 Aug 22 16:10:52.942227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 559/1102] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:53.613139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:53.613786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:53.620356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:53.620873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:53.621307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:53.622008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:53.622455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:53.622877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:53.688289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:53.697965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eae4c536-5772-45f5-b647-b2c042e51531 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088485 Aug 22 16:10:53.698549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 544/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:53 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:53.953206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:53.955372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:53.961969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:53.962448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:53.962877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:53.963615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:53.964123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:53.964850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:53.994272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8087b3e8-e74e-43f3-806b-742b7e3b6aef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Aug 22 16:10:53.994831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 560/1104] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:54.718994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:54.719595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:54.725921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:54.726405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:54.726842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:54.727565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:54.728020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:54.728445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:54.794373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:54.802797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6e206d3d-dee5-4fb5-a843-cf285165500a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088264 Aug 22 16:10:54.803383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 545/1105] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:54 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:55.006657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:55.009714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:55.016921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:55.017408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:55.017858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:55.018598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:55.019055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:55.019509 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:55.049981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fbbc171c-e334-4d03-8e83-0bb5f94d577f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047172 Aug 22 16:10:55.050537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 561/1106] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:55.824727 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:55.825375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:55.832256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:55.832735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:55.833170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:55.833864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:55.834319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:55.834748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:55.897012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:55.904689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6bbae2cb-6d6c-42aa-ba7e-cdd27ce12986 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083854 Aug 22 16:10:55.905245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 546/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:55 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:56.062054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:56.064807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:56.071423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:56.071914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:56.072408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:56.073109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:56.073565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:56.073994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:56.104510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-347bed82-2887-4659-92b6-84e7b85fd292 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Aug 22 16:10:56.104989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 562/1108] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:56.926045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:56.926663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:56.933165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:56.933651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:56.934085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:56.934778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:56.935233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:56.935688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:56.998552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:57.006287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-43a14e85-288a-4767-bc7a-48903106b93a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084143 Aug 22 16:10:57.006877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 547/1109] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:56 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:57.116562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:57.118700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:57.125041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:57.125518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:57.125949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:57.126631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:57.127078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:57.127528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:57.158014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bb67e3c0-0e2c-455c-a5f8-820b2c41da3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Aug 22 16:10:57.158572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 563/1110] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:58.026515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:58.027151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:58.034285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:58.034784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:58.035202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:58.035918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:58.036378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:58.036810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:58.100287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:58.108276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2592746f-5e18-46db-8b28-dc5c3cfa00d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085662 Aug 22 16:10:58.108848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 548/1111] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:58 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:58.170183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:58.172396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:58.179043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:58.179567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:58.180318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:58.180704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:58.181160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:58.181585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:58.211387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5c4faa13-5a62-4054-a337-d618e812af99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Aug 22 16:10:58.211871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 564/1112] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:10:59.129009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:59.129616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:59.136070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:59.136550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:59.136991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:59.137682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:59.138136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:59.138556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:59.202729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:10:59.211297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b1ce4556-5ae8-4d2e-90ea-b7de775f48c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086282 Aug 22 16:10:59.211881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 549/1113] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:10:59 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:10:59.223976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:10:59.226256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:10:59.232678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:59.233153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:59.233586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:59.234264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:10:59.234853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:10:59.235381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:10:59.264317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d03694be-ebaa-40a7-980d-5da222bd819a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Aug 22 16:10:59.264870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 565/1114] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:10:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:00.231309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:00.231927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:00.238857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:00.239347 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:00.239793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:00.240487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:00.240939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:00.241363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:00.277071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:00.279392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:00.285714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:00.286194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:00.286619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:00.287310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:00.287780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:00.288199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:00.302376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:00.310142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6f4245b4-3b67-489e-818d-74cd6cd2da91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082798 Aug 22 16:11:00.311084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 550/1115] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:00 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:00.320649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a61c57a2-dcea-46e1-badc-07ddeec0e56f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047315 Aug 22 16:11:00.321284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 566/1116] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:11:01.333088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:01.333775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:01.334169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:01.335380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:01.340874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:01.341377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:01.342656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:01.342893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:01.343417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:01.343614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:01.343930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:01.344129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:01.344550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:01.344670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:01.345094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:01.345699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:01.349507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:01.376115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6182ecda-db25-428e-a09a-225fd53804a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047508 Aug 22 16:11:01.378755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 567/1117] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:11:01.418608 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:01.426386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-02372f6c-4927-4421-b99a-67c952086405 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.098113 Aug 22 16:11:01.426947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 551/1118] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:01 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:02.388904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:02.391096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:02.397290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:02.397772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:02.398209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:02.398895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:02.399367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:02.399791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:02.428859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b2206b4c-0af3-4045-98a8-e76e0ea48224 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Aug 22 16:11:02.429401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 568/1119] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:02.446332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:02.446977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:02.453526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:02.454008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:02.454446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:02.455137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:02.455615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:02.456042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:02.521080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:02.528766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f2869de0-6adb-46ff-a4e8-d3947a253e72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086265 Aug 22 16:11:02.529324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 552/1120] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:02 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:03.441152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:03.443984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:03.450555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:03.451045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:03.451524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:03.452225 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:03.452685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:03.453123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:03.482379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c20c8fcb-7e5f-4665-8197-df4116a78e90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Aug 22 16:11:03.482928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 569/1121] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:03.549647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:03.550298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:03.556736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:03.557217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:03.557656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:03.558348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:03.558805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:03.559231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:03.620176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:03.628444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-842f0cd1-456c-4881-ab89-c284233aa7c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082732 Aug 22 16:11:03.629004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 553/1122] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:03 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:04.494719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:04.496893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:04.503549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:04.504036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:04.504504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:04.505209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:04.505656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:04.506079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:04.536542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3df91851-5bb2-4446-896c-923cec6f90e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Aug 22 16:11:04.537112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 570/1123] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:04.649275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:04.649975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:04.656526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:04.657005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:04.657441 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:04.658186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:04.658677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:04.659619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:04.721330 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:04.729155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8e362e0e-96c9-41d7-b765-1efb5db5f44b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083919 Aug 22 16:11:04.729706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 554/1124] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:04 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:05.549660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:05.552211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:05.554846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=52 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:05.560298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:05.560778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:05.561210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:05.561891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:05.562336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:05.562752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:05.593232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-57158e39-1141-419a-bd8d-84c2460f0669 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048386 Aug 22 16:11:05.593779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 571/1125] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:05.749321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:05.749979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:05.752284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=50 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:05.757750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:05.758230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:05.758664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:05.759442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:05.759838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:05.760261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:05.822024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:05.829758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-126aae8e-e25c-4a75-b6cf-a5e24b83c250 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084303 Aug 22 16:11:05.830334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 555/1126] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:05 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:06.605967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:06.608149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:06.615116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:06.615616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:06.616047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:06.616727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:06.617175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:06.617594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:06.647596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-21a079e4-b977-43e2-8b80-8038d9c17969 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Aug 22 16:11:06.648153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 572/1127] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:06.850592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:06.851208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:06.857707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:06.858185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:06.858619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:06.859309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:06.859795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:06.860219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:06.924799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:06.932645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-df54828d-ebc7-4467-850d-bf1a6f35bad3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085932 Aug 22 16:11:06.933211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 556/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:06 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:07.661075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:07.663399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:07.670157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:07.670645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:07.671082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:07.671819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:07.672272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:07.672694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:07.703287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-01276bfc-d7df-4dd7-af7f-32e04c83ed40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 Aug 22 16:11:07.703891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 573/1129] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:11:07.954584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:07.955819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:07.961673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:07.962146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:07.962586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:07.963421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:07.963734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:07.964163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:07.967092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:08.029028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:08.037912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e8f5bca4-dad4-4c00-adc4-004d0726a8d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087717 Aug 22 16:11:08.038479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 557/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:07 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:08.716532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:08.718702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:08.725644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:08.726126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:08.726570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:08.727259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:08.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:08.728171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:08.757610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2bc80b48-7fa2-4373-8f45-a0188d849c21 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Aug 22 16:11:08.758169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 574/1131] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:09.059197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:09.059946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:09.066026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:09.066516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:09.066955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:09.067707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:09.068160 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:09.068593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:09.131428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:09.139204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e592ea6-2dfd-4522-9499-acabac72cf1c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084679 Aug 22 16:11:09.139792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 558/1132] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:09 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:09.770987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:09.773316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:09.779992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:09.780473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:09.780945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:09.781754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:09.782352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:09.782860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:09.814958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eabd45c7-40fa-42e4-9dae-c728b7cb7737 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047937 Aug 22 16:11:09.815574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 575/1133] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:10.160745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:10.162216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:10.169076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:10.169714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:10.170159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:10.170865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:10.171320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:10.171799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:10.235653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:10.244244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6b84cf75-f16a-44fb-9768-8d175b59ff22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087464 Aug 22 16:11:10.244827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 559/1134] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:10 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:10.827476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:10.830211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:10.836657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:10.837140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:10.837575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:10.838261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:10.838708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:10.839147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:10.870552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-49837b6e-7c6e-44a9-8bbd-39de596e006e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Aug 22 16:11:10.871115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 576/1135] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:11.265017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:11.265627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:11.272652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:11.273124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:11.273556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:11.274234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:11.274679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:11.275099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:11.341050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:11.348977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-307b197d-d05b-4049-a102-88329ba805fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087815 Aug 22 16:11:11.349552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 560/1136] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:11 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:11.882955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:11.885284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:11.891851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:11.892330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:11.892776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:11.893479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:11.893919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:11.894336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:11.923253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d3b41f32-3624-46fb-9124-e9f227722e93 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 22 16:11:11.923827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 577/1137] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:12.370929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:12.371563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:12.378564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:12.379041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:12.379516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:12.380203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:12.380654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:12.381073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:12.442051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:12.450264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9d7e56bc-13bd-4153-8e63-420faabad061 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083204 Aug 22 16:11:12.450964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 561/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:12 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:12.936017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:12.938193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:12.945518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:12.946004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:12.946444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:12.947133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:12.947615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:12.948046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:12.976791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6714c9fb-0848-40fb-9ae0-d1c8eebb0e59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Aug 22 16:11:12.977359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 578/1139] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:13.470808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:13.471478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:13.478027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:13.478512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:13.478951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:13.479680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:13.480132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:13.480558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:13.541728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:13.550063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-25d572f4-b50e-4334-98ed-4f12e8bb8fc8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082846 Aug 22 16:11:13.550661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 562/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:13 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:13.990033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:13.992281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:13.998315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:13.998799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:13.999235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:13.999958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:14.000419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:14.000846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:14.028991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e0d2567-bd34-4e32-95ab-0cf80a3f49ce tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043680 Aug 22 16:11:14.029556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 579/1141] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:14.570066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:14.570683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:14.577215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:14.577698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:14.578139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:14.578836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:14.579302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:14.579756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:14.642124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:14.650345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ee408206-64e2-4aaa-b516-544b53e25941 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084167 Aug 22 16:11:14.650912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 563/1142] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:14 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:15.040535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:15.042702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:15.049168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:15.050158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:15.050599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:15.051292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:15.051772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:15.052198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:15.081228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3893f014-5c50-4cbc-ad94-b058ea48f476 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Aug 22 16:11:15.081786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 580/1143] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:15.672069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:15.672646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:15.680007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:15.680488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:15.680929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:15.681628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:15.682108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:15.682505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:15.751205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:15.759515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7d77c148-ea53-40c6-ae3b-8ee0d9fab523 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091363 Aug 22 16:11:15.760099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 564/1144] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:15 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:16.093134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:16.095413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:16.101837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:16.102330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:16.102762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:16.103697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:16.104192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:16.104624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:16.134841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-60d38bbb-2efc-42c8-a3d7-730eb7a323c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Aug 22 16:11:16.135428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 581/1145] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:16.780682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:16.781276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:16.787467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:16.787945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:16.788367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:16.789055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:16.789517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:16.790029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:16.852773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:16.863080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a6dc43bf-eff2-44ac-9bed-14ebf5ac5721 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086093 Aug 22 16:11:16.863760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 565/1146] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:16 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:17.147716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:17.149884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:17.156514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:17.157005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:17.157446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:17.158136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:17.159162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:17.159625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:17.188512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0955a813-85af-425b-8cc0-b844736ce3fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045387 Aug 22 16:11:17.189062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 582/1147] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:17.884226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:17.884809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:17.891265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:17.891767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:17.892195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:17.892870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:17.893958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:17.894376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:17.954853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:17.963243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e3c72eb2-85c7-4b10-b46d-9defc0535be6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082832 Aug 22 16:11:17.963830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 566/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:17 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:18.201349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:18.203466 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:18.210386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:18.210866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:18.211305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:18.212051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:18.212517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:18.212935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:18.238453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:18.244333 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3394a263-7aa1-4c63-ac1f-aca92d777abc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Aug 22 16:11:18.244912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 583/1149] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:18.983860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:18.984499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:18.991354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:18.991846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:18.992278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:18.992970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:18.993419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:18.993847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:19.055977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:19.063781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c1de9d8b-ede5-4a1e-addd-c5272e95af8c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083797 Aug 22 16:11:19.064351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 567/1150] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:18 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:19.257882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:19.260235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:19.266561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:19.267033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:19.267504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:19.268189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:19.268635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:19.269053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:19.298140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-504c38aa-b77a-4212-9a2d-068a5ed211d7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Aug 22 16:11:19.298674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 584/1151] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:20.085827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:20.086436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:20.093083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:20.093561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:20.094014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:20.094731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:20.095151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:20.095599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:20.159282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:20.167093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-df32bb1f-7064-4499-99b0-c1c1d954eee6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085753 Aug 22 16:11:20.167692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 568/1152] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:20 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:20.311309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:20.313520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:20.320508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:20.321286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:20.321866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:20.322734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:20.323378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:20.323910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:20.352905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c5d9de0c-695f-45d9-8b58-aa2f2b25354c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045912 Aug 22 16:11:20.353472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 585/1153] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:21.187561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:21.188197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:21.194535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:21.195034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:21.195536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:21.196267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:21.196718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:21.197139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:21.259926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:21.267597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3d46663c-57ed-462d-b785-6dc5e4a476e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083938 Aug 22 16:11:21.268153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 569/1154] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:21 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:21.365270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:21.367459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:21.373941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:21.374421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:21.374886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:21.375610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:21.376063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:21.376488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:21.407043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4cb1873f-e8d9-40a2-a99e-9a8659ab4aa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Aug 22 16:11:21.407663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 586/1155] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:22.289149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:22.289680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:22.296095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:22.296579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:22.297021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:22.297717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:22.298172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:22.298596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:22.362505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:22.371007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7f34a953-a112-4239-8265-f63cb18a2bb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086429 Aug 22 16:11:22.371588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 570/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:22 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:22.419357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:22.421548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:22.428789 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:22.429277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:22.429717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:22.430416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:22.430873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:22.431301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:22.461084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-589ce6c3-b6ea-48a0-8ad2-a79f8c19a913 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Aug 22 16:11:22.461643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 587/1157] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:23.391796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:23.392388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:23.399672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:23.400159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:23.400627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:23.401314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:23.401812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:23.402237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:23.466923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:23.474322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:23.475235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-12b8f853-dda0-4fd1-be38-d8e501b6329e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087327 Aug 22 16:11:23.475835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 571/1158] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:23 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:23.476592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:23.483043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:23.483557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:23.483993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:23.484684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:23.485135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:23.485564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:23.514058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-69ea2904-a3d8-4005-9f96-36a2bece3fc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Aug 22 16:11:23.518715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 588/1159] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:11:24.496043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:24.496815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:24.503505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:24.503990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:24.504427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:24.505140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:24.505598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:24.506078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:24.526340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:24.528616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:24.535109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:24.536202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:24.536645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:24.537353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:24.538103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:24.538536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:24.569480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0e64153a-ae2b-457b-ab83-34063b56e13d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Aug 22 16:11:24.570086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 589/1160] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:11:24.576095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:24.584024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f1043206-f4c1-49c5-8f51-d0552296ce49 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091912 Aug 22 16:11:24.584598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 572/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:24 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:25.582078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:25.584289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:25.590977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:25.591486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:25.591925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:25.592615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:25.593066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:25.593490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:25.605070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:25.606086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:25.612436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:25.612928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:25.613364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:25.614590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:25.615703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:25.615703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:25.625331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-06e09abc-e3ea-4376-b013-5438602a6803 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047187 Aug 22 16:11:25.625901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 590/1162] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:25.683221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:25.685494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:25.693246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-af7c1558-f7a8-4639-91ed-6c8c18ede59d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.092174 Aug 22 16:11:25.693853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 573/1163] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:25 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:11:26.638304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:26.640532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:26.647651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:26.648164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:26.648606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:26.649308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:26.649767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:26.650195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:26.679652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-606f4737-acb8-4985-8fb7-ebe30e71a790 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Aug 22 16:11:26.680233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 591/1164] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:26.714257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:26.714828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:26.721743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:26.722221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:26.722819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:26.723551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:26.724035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:26.724459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:26.789256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:26.797446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e582b5bd-295a-4009-b9fa-a28d5506aa83 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087101 Aug 22 16:11:26.798015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 574/1165] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:26 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:27.691271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:27.693454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:27.700104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:27.700586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:27.701028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:27.701719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:27.702169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:27.702603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:27.733101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7a9da071-6a17-4724-ab19-b97aca4c740f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045741 Aug 22 16:11:27.733674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 592/1166] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:27.818198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:27.818823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:27.825337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:27.825813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:27.826250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:27.826942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:27.827426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:27.827851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:27.890707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:27.899081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c1a06df1-0b6d-4987-8b74-3c2b9ed7add9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084848 Aug 22 16:11:27.899721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 575/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:27 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:28.744754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:28.746926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:28.753408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:28.753891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:28.754334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:28.755026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:28.755516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:28.755946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:28.786180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1e71649a-c40e-4cf3-833c-a3e417a90e18 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045319 Aug 22 16:11:28.786764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 593/1168] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:28.919829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:28.920504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:28.926792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:28.927269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:28.927735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:28.928432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:28.928885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:28.929301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:28.993321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:29.001069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ff998c28-f7ff-4894-a915-c2ec79643f10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085143 Aug 22 16:11:29.001635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 576/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:28 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:29.799516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:29.801560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:29.808234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:29.808724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:29.809163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:29.809922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:29.810328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:29.810758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:29.842254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-306f8cd4-68cf-479d-9873-d16e796ed79c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046858 Aug 22 16:11:29.842833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 594/1170] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:30.022059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:30.023180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:30.029661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:30.030121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:30.030558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:30.031280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:30.031760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:30.032186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:30.097488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:30.105998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8bdde6a-0b18-448f-9b5d-d12926607796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087760 Aug 22 16:11:30.106579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 577/1171] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:30 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:30.856902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:30.861039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:30.868934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:30.869425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:30.869866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:30.870570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:30.871074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:30.871490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:30.901176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d68a93ff-b721-4852-948c-dc1a6dca8315 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049382 Aug 22 16:11:30.901767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 595/1172] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:31.126203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:31.126767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:31.133824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:31.134299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:31.134733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:31.135449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:31.135904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:31.136355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:31.196818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:31.204491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e6faa34-1a23-48f6-9bf6-5438beb0538c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082300 Aug 22 16:11:31.205043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 578/1173] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:31 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:31.913615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:31.915847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:31.922260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:31.922742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:31.923185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:31.923919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:31.924377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:31.924806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:31.953751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-18e91972-5fe3-4287-b259-9ec4f287d364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Aug 22 16:11:31.954317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 596/1174] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:32.226416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:32.227557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:32.233653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:32.234181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:32.234621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:32.235318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:32.235793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:32.236217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:32.297363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:32.305612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5a2bcc26-1dbb-4107-99aa-a5471ffde245 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083586 Aug 22 16:11:32.306181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 579/1175] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:32 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:32.966863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:32.969215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:32.976282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:32.976770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:32.977210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:32.977905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:32.978360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:32.978784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:33.007250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-37d09b3f-95c7-459b-83cd-0315cefa8e1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Aug 22 16:11:33.007836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 597/1176] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:33.326534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:33.327139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:33.333492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:33.333966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:33.334397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:33.335756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:33.336210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:33.336631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:33.400423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:33.408225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f6ade275-ee95-4d00-b89c-699e008b6816 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085731 Aug 22 16:11:33.408806 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 580/1177] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:33 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:34.019662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:34.021826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:34.028786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:34.029269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:34.029712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:34.030410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:34.030873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:34.031306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:34.060384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2d1346f3-6a44-49fc-a71d-7fd4869c4b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Aug 22 16:11:34.060940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 598/1178] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:34.430190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:34.430794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:34.437146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:34.437615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:34.438046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:34.438730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:34.439172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:34.439622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:34.502529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:34.510762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-447a0ca9-92f3-4c4a-9c3c-cb7d841ec9c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085136 Aug 22 16:11:34.511302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 581/1179] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:34 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:35.072230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:35.074734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:35.081195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:35.081673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:35.082104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:35.082787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:35.083238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:35.083689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:35.114872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-244f8769-56bc-46d0-b66b-b55b6f981b50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Aug 22 16:11:35.115385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 599/1180] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:11:35.533118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:35.533694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:35.540942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:35.541187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:35.541625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:35.542324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:35.542779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:35.543211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:35.604083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:35.611928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-84a6c5d6-87e9-479d-a096-7a454d4a5e4d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082891 Aug 22 16:11:35.612488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 582/1181] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:35 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:36.127275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:36.129461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:36.131826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=58 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:36.137430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:36.137935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:36.138386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:36.139078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:36.139567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:36.139998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:36.154139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:36.171121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dad44615-b675-48cc-b627-85ba66e078f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Aug 22 16:11:36.171722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 600/1182] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:36.768594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:36.769206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:36.771072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=56 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:36.778294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:36.778858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:36.779217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:36.779956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:36.780451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:36.780831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:36.842797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:36.851144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-79d00bac-beea-47ca-a8a4-2300bf7a722e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.220508 Aug 22 16:11:36.851734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 583/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:36 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:37.183191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:37.185293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:37.191821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:37.192310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:37.192748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:37.193439 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:37.193896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:37.194866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:37.224491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-373239c4-2acd-42f8-b3c9-3ee9b810988d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Aug 22 16:11:37.225057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 601/1184] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:37.871888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:37.872535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:37.879028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:37.879554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:37.879993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:37.880691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:37.881146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:37.881573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:37.947782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:37.955454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a7a2b4ad-6cdf-479b-958f-0bec3de59e05 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087491 Aug 22 16:11:37.956018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 584/1185] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:37 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:38.236926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:38.239010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:38.246186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:38.246673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:38.247117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:38.247847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:38.248305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:38.248733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:38.278324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d86b8e46-b32d-4b03-b3c9-0a62ed46a531 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Aug 22 16:11:38.278894 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 602/1186] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:38.980092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:38.980705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:38.989561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:38.990270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:38.990909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:38.991952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:38.992619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:38.993253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:39.057720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:39.065515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e76fa6d0-ed84-4123-a40d-936fc3166a82 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091877 Aug 22 16:11:39.066089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 585/1187] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:38 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:39.291584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:39.294068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:39.301652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:39.302226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:39.302764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:39.303631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:39.304164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:39.304674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:39.340912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c6382524-59ae-4fdc-aea7-f18fc400b667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053935 Aug 22 16:11:39.341613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 603/1188] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:40.086935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:40.087601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:40.094321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:40.094801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:40.095243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:40.095977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:40.096426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:40.096849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:40.160264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:40.169179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7c539524-15c5-435b-9972-3a9867221c7d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086201 Aug 22 16:11:40.169740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 586/1189] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:40 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:40.355113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:40.357322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:40.363848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:40.364329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:40.364764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:40.365460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:40.365906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:40.366326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:40.395820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bc876fd7-78bb-45ea-be4f-5a718e3f50c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Aug 22 16:11:40.396381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 604/1190] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:41.191824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:41.192488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:41.199637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:41.200125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:41.200606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:41.201423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:41.202055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:41.202529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:41.265894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:41.274026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-845aeada-537e-48ce-840d-77bf223721a5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086086 Aug 22 16:11:41.274854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 587/1191] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:41 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:41.408938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:41.411045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:41.417771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:41.418256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:41.418713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:41.419435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:41.419896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:41.420330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:41.450785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-19d9e54b-68b6-4912-a9c4-b1fc8b8b11b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Aug 22 16:11:41.451413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 605/1192] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:42.295427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:42.296027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:42.303113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:42.303684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:42.304182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:42.304951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:42.305435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:42.305916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:42.374051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:42.382142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8289bde0-7849-417e-9bb2-14ac7e8fd9af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091169 Aug 22 16:11:42.382710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 588/1193] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:42 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:42.464568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:42.467019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:42.473609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:42.474090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:42.474530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:42.475223 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:42.475767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:42.476194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:42.505519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4d1573cd-0daf-4b49-8c8b-fecea545b7dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045827 Aug 22 16:11:42.506091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 606/1194] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:43.404370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:43.405100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:43.411964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:43.412494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:43.412962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:43.413700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:43.414207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:43.414639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:43.476668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:43.485204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8ff691b-b733-4efd-8b13-1afe08b7553d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085599 Aug 22 16:11:43.485761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 589/1195] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:43 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:43.519448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:43.521871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:43.529080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:43.529575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:43.530072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:43.530812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:43.531276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:43.531741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:43.562493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c7f8a5d5-c7b7-4c62-a796-0f74b5f8a528 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047750 Aug 22 16:11:43.563058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 607/1196] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:44.505630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:44.506233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:44.512931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:44.513411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:44.513850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:44.514548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:44.515000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:44.515468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:44.530388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:44.575684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:44.578538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:44.581796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:44.586079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:44.586598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:44.587041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:44.587775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:44.588235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:44.588664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:44.589853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-464f9f3e-11da-4049-97d8-9970aa598226 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088352 Aug 22 16:11:44.590454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 590/1197] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:44 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:44.620141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2a41cde4-4ce7-48e6-b35b-94a355d6b422 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048808 Aug 22 16:11:44.620707 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 608/1198] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:45.614318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:45.614924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:45.621486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:45.621972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:45.622404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:45.623109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:45.623599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:45.624032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:45.632739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:45.634897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:45.641741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:45.642239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:45.642675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:45.643414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:45.643868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:45.644290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:45.676789 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f48f41d6-7d02-499c-b354-36250de6a676 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Aug 22 16:11:45.677502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 609/1199] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:11:45.688560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:45.698336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-07431b62-5650-4254-9dc6-75e6a98e187e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087768 Aug 22 16:11:45.699001 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 591/1200] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:45 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:46.689138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:46.691292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:46.697885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:46.698373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:46.698817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:46.699546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:46.700007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:46.700435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:46.722969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:46.723640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:46.730599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:46.731117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:46.731431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e70e03f3-b81c-4703-b84b-35097f10632b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Aug 22 16:11:46.731594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:46.732005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 610/1201] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:46.732265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:46.732719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:46.733145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:46.800939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:46.809408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-97cce982-d621-4a32-9377-0e4d3c9e214a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090810 Aug 22 16:11:46.809972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 592/1202] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:46 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:11:47.744576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:47.746843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:47.753581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:47.754061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:47.754495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:47.755200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:47.755677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:47.756101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:47.788388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bcae7126-a559-4028-a7ca-4f1ad115b059 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048787 Aug 22 16:11:47.788965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 611/1203] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:47.829427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:47.830037 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:47.836490 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:47.836968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:47.837404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:47.838600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:47.839050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:47.839509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:47.908448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:47.916740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-47ac92e5-0d74-44cb-8904-f84eb3762510 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090863 Aug 22 16:11:47.917303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 593/1204] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:47 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:48.801445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:48.803895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:48.811207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:48.811728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:48.812169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:48.812873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:48.813331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:48.813755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:48.843830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0b5dff92-5f15-40e7-81d0-430a45a72e64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046385 Aug 22 16:11:48.844398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 612/1205] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:48.938557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:48.939225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:48.946333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:48.946880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:48.947404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:48.948156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:48.948643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:48.949144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:49.019614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:49.028138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-18368bcb-f2aa-4365-8f20-87b8c3847149 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.094020 Aug 22 16:11:49.028704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 594/1206] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:48 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:49.856454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:49.858686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:49.865382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:49.865866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:49.866309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:49.867015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:49.867506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:49.867938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:49.900377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b5a8b1c6-b205-4966-a263-e24877336b0a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048440 Aug 22 16:11:49.900966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 613/1207] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:50.049110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:50.049836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:50.057594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:50.058075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:50.058516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:50.059218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:50.059975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:50.060405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:50.122229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:50.130117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f9b85e7b-bd3d-4de8-ae25-c3c84e591090 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085389 Aug 22 16:11:50.131643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 595/1208] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:50 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:50.912752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:50.914948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:50.922185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:50.922674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:50.923118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:50.923861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:50.924320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:50.924746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:50.955582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bd7aabe7-16bb-4008-a9be-684bcbd5c5fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046615 Aug 22 16:11:50.956239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 614/1209] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:51.150646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:51.151276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:51.158010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:51.158489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:51.158926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:51.159658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:51.160137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:51.160562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:51.226427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:51.234993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2b62adb9-7350-43e9-871e-23706f141902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088728 Aug 22 16:11:51.235575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 596/1210] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:51 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:51.970469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:51.972715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:51.979743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:51.980221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:51.980649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:51.981332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:51.981777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:51.982191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:52.011588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e392d6b9-12dc-4918-97d1-1a0ad02a4d40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Aug 22 16:11:52.012175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 615/1211] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:52.256046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:52.256645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:52.263570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:52.264055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:52.264524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:52.265227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:52.265678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:52.266104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:52.331006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:52.339454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-04cc1681-5eaf-4515-bd0b-bec9fd591bcc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087393 Aug 22 16:11:52.340020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 597/1212] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:52 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:53.023723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:53.026494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:53.032956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:53.033435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:53.033907 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:53.034605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:53.035065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:53.035528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:53.070423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6d3e0c82-cbed-4456-9f93-77a4e27cfa06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050671 Aug 22 16:11:53.070999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 616/1213] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:53.360791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:53.361416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:53.367756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:53.368225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:53.368650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:53.369867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:53.370314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:53.370753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:53.431922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:53.439965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-025ac124-05ec-4bf1-9b8f-e21dc65bf463 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083390 Aug 22 16:11:53.440584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 598/1214] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:53 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:54.083514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:54.085706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:54.093428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:54.093922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:54.094363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:54.095068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:54.095559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:54.095989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:54.098432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:11:54.126272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b53fe12f-30f2-4f25-b9e7-d6bb74ddfa50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047030 Aug 22 16:11:54.126831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 617/1215] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:54.461584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:54.462190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:54.469222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:54.469798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:54.470295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:54.471030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:54.471777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:54.473059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:54.542516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:54.554132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8ef88816-d39f-40b9-b90e-5efc8cf40416 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.096502 Aug 22 16:11:54.554971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 599/1216] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:54 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:55.139192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:55.141390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:55.148600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:55.149082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:55.149526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:55.150854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:55.151312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:55.151767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:55.181092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7dac4ae1-a0f5-455d-b78e-1e18fbcedd84 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046405 Aug 22 16:11:55.181743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 618/1217] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:55.575021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:55.575644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:55.583035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:55.583553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:55.583988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:55.584691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:55.585141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:55.585566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:55.650888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:55.659123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6c0fa323-33eb-404b-b503-9f263924345f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087972 Aug 22 16:11:55.659722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 600/1218] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:55 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:56.195247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:56.198052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:56.204513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:56.204994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:56.205432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:56.206188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:56.206688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:56.207058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:56.235709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b1440e95-e80a-4ec6-8033-4adde9f24a6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Aug 22 16:11:56.236286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 619/1219] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:56.680470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:56.681115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:56.689229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:56.690105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:56.691315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:56.692514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:56.693205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:56.693641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:56.760224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:56.768210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2a62d2ea-a96e-46dc-819e-680b38a1f07b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091624 Aug 22 16:11:56.768773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 601/1220] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:56 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:11:57.248752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:57.250937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:57.257907 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:57.258395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:57.258823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:57.260049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:57.260506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:57.260933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:57.293208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6b9089ae-6be9-40c6-8b9e-54bb8b5e1c9e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048316 Aug 22 16:11:57.294783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 620/1221] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:11:57.788227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:57.788840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:57.796051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:57.796459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:57.796892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:57.797588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:57.798038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:57.798463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:57.861650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:57.870076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-95dc2763-6645-4f81-81a4-f48b9dd61117 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085901 Aug 22 16:11:57.870650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 602/1222] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:57 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:58.307414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:58.309607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:58.316071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:58.316546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:58.317041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:58.317663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:58.318110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:58.318532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:58.348747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f75cfbae-90e0-475b-ae6b-548c5de705ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Aug 22 16:11:58.349315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 621/1223] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:58.890802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:58.891438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:58.897967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:58.898444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:58.898878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:58.899601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:58.900054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:58.900482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:58.965705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:11:58.973772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1c59d3b3-3671-4d61-b5a6-3b143db05818 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086858 Aug 22 16:11:58.974338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 603/1224] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:58 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:11:59.361195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:59.363656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:11:59.372276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:59.372875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:59.373475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:59.375155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:11:59.375677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:11:59.376114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:11:59.407124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b1fab2d4-8adc-4250-8546-950c9bee791e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050247 Aug 22 16:11:59.407711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 622/1225] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:11:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:11:59.997050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:11:59.997725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:00.004727 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:00.005359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:00.005892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:00.006780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:00.007363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:00.007917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:00.076602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:00.084447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2ad1ce4d-aeb2-4e99-80b7-1ca5802a563d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.092962 Aug 22 16:12:00.085024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 604/1226] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:11:59 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:00.419679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:00.421855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:00.428642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:00.429132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:00.429572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:00.430304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:00.430731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:00.431165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:00.461989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d6f9a688-e97b-4725-b389-4c111c849848 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046859 Aug 22 16:12:00.462591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 623/1227] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:01.107187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:01.107870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:01.114825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:01.115221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:01.115682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:01.116381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:01.116832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:01.117253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:01.189049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:01.197467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e10767a-e2fd-4653-bb14-fee19198b469 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.094364 Aug 22 16:12:01.198038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 605/1228] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:01 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:01.477512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:01.480208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:01.486613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:01.487087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:01.487569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:01.488255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:01.488700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:01.489121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:01.518903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d175c83c-dd05-46fe-bf5c-0f90bc21d3c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Aug 22 16:12:01.519555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 624/1229] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:02.218458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:02.219255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:02.228333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:02.229214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:02.230050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:02.230959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:02.231447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:02.231880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:02.294912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:02.302920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-275b828a-9eb6-42d2-94c5-1c984c21fe86 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088753 Aug 22 16:12:02.303519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 606/1230] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:02 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:02.531386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:02.533609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:02.541249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:02.541435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:02.541847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:02.542619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:02.543004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:02.543473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:02.574286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-61dafcee-8bf8-4926-858e-14a0f2615e25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046834 Aug 22 16:12:02.574838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 625/1231] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:03.324234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:03.326457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:03.332636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:03.333358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:03.334013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:03.335055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:03.335792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:03.336428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:03.342847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:03.426358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:03.436358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-44df9e6a-68c3-4167-9f72-f901d4bb517a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.116093 Aug 22 16:12:03.436938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 607/1232] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:03 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:12:03.586479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:03.591654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:03.598156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:03.598638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:03.599073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:03.599808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:03.600261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:03.600682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:03.637091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-69f68614-5b42-4462-bd2d-81382a2404f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054707 Aug 22 16:12:03.637711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 626/1233] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:04.457446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:04.458184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:04.465633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:04.466386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:04.466821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:04.467574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:04.468022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:04.468487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:04.535063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:04.543203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f9a60196-ca9f-4bfa-8ba7-3a46fa49da1a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090436 Aug 22 16:12:04.543809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 608/1234] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:04 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:04.649194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:04.651402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:04.658787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:04.659310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:04.659938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:04.660645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:04.661099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:04.661527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:04.691482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-57aec0d8-28c8-4e3c-897e-82d1c72a97ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Aug 22 16:12:04.692058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 627/1235] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:05.563915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:05.564527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:05.571094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:05.571614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:05.572560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:05.573261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:05.573711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:05.574137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:05.636039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:05.643798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f62a6b50-c9a9-4150-a4c3-48e6fa2d37be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083852 Aug 22 16:12:05.644375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 609/1236] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:05 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:05.704708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:05.706944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:05.714185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:05.714670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:05.715107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:05.715827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:05.716536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:05.716963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:05.746201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a5a0fd4c-43ff-47b3-bc23-3e837268a19f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Aug 22 16:12:05.746767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 628/1237] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:06.665339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:06.666594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:06.673599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:06.674092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:06.674534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:06.675389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:06.675767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:06.676206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:06.743098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:06.751613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d85fe111-9c59-4d7a-9940-48e97039689b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090193 Aug 22 16:12:06.752405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 610/1238] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:06 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:06.758376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:06.761363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:06.763766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=58 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:06.769064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:06.769554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:06.769991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:06.770705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:06.771155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:06.771682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:06.801502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c3c8945b-b970-46c3-8e9d-d1fe8c97cf8b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Aug 22 16:12:06.801981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 629/1239] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:07.773287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:07.773865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:07.776987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=56 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:07.782513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:07.783051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:07.783594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:07.784302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:07.784759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:07.785218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:07.813738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:07.815894 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:07.823058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:07.823566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:07.823998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:07.824694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:07.825143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:07.825560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:07.848376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:07.856106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-20146c48-70bc-4f86-8d16-8936b5b35f4f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086957 Aug 22 16:12:07.856355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0e9c0262-2fd8-4e81-9c13-6edf393ec1a3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046490 Aug 22 16:12:07.856681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 611/1240] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:07 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:07.857212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 630/1241] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:12:08.868579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:08.870909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:08.876367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:08.876990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:08.877737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:08.878223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:08.878660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:08.879368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:08.879815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:08.880236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:08.884884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:08.885373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:08.886042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:08.886937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:08.887624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:08.888060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:08.911199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dc3af79a-d37a-4aa6-b215-9d72f57d7b2d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046508 Aug 22 16:12:08.911809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 612/1242] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:08.953946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:08.961772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-848e2d55-e153-4cfa-a2ed-a62eea08b421 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089247 Aug 22 16:12:08.962337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 631/1243] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:08 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:12:09.924464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:09.926637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:09.933569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:09.934051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:09.934481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:09.935178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:09.935658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:09.936080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:09.965374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ce0cdff7-6796-4120-ad0d-9362004992f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Aug 22 16:12:09.966191 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 613/1244] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:09.983449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:09.984060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:09.990889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:09.991411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:09.991832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:09.992524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:09.992981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:09.993403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:10.054240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:10.062564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0f7100e0-0d3e-4921-82ff-c699449ab0c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082970 Aug 22 16:12:10.063128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 632/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:09 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:10.978022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:10.980239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:10.986620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:10.987087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:10.987546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:10.988235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:10.988682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:10.993468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:11.018928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8463d308-9195-4e8c-8593-24651a0e7189 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 22 16:12:11.019512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 614/1246] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:11.081959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:11.082658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:11.089848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:11.090330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:11.090773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:11.091756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:11.092219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:11.092653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:11.155745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:11.157922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:11.164795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-08d7a0e4-1e32-4c8f-b052-4e5287665016 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086742 Aug 22 16:12:11.165361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 633/1247] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:11 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:12.032184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:12.034299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:12.041789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:12.042277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:12.042715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:12.043453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:12.043909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:12.044337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:12.074993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8acbd31c-1d72-4d96-9b5a-6c4234323367 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046827 Aug 22 16:12:12.075603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 615/1248] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:12.185349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:12.185957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:12.192438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:12.192921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:12.193360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:12.194048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:12.194643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:12.195079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:12.255928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:12.264185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-89bccf93-4783-4738-8a49-7534c864cd3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082754 Aug 22 16:12:12.264749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 634/1249] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:12 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:13.087481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:13.089714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:13.096497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:13.096980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:13.097415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:13.098113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:13.098562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:13.098979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:13.129860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-476a93ae-f4aa-4a7e-b6df-89fd0ec54a51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 Aug 22 16:12:13.130430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 616/1250] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:13.285323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:13.285945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:13.292725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:13.293207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:13.293647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:13.294342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:13.294798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:13.295226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:13.360260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:13.368122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d107ace5-01fe-41de-b513-11577c103517 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086827 Aug 22 16:12:13.368719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 635/1251] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:13 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:14.143812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:14.145984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:14.153078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:14.153562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:14.153996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:14.154692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:14.155142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:14.155589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:14.185915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-31cf6666-b51e-45f2-97e7-437c0018cd7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Aug 22 16:12:14.186479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 617/1252] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:14.389888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:14.390514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:14.397117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:14.397591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:14.398028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:14.398721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:14.399185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:14.399649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:14.461958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:14.470716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-88db4cf9-a558-46c3-97d4-a9b1a191cd32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084994 Aug 22 16:12:14.471288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 636/1253] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:14 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:15.198824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:15.201027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:15.207585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:15.208095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:15.208530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:15.209224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:15.209681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:15.210182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:15.240349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3670f622-8688-455c-b35f-d2ba8cb3974f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046138 Aug 22 16:12:15.240900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 618/1254] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:15.491701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:15.492243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:15.499449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:15.499934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:15.500373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:15.501100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:15.501556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:15.501998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:15.564233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:15.572100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bcca891f-c503-4919-b5ff-ea27b4615e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084325 Aug 22 16:12:15.572672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 637/1255] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:15 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:16.253604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:16.255714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:16.262704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:16.263187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:16.263845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:16.264550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:16.265006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:16.265433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:16.294253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-78eb1dbf-84bb-4b24-b2d1-6021d19e3d0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Aug 22 16:12:16.294807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 619/1256] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:16.593554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:16.594200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:16.600573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:16.601048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:16.601476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:16.602155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:16.602604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:16.603021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:16.664731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:16.673080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d924d94c-902f-44bb-a808-66dc64eb44c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084296 Aug 22 16:12:16.673641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 638/1257] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:16 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:17.306606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:17.308882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:17.315017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:17.315533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:17.315971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:17.316655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:17.317105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:17.317529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:17.347466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2f1519be-77bc-4ed4-b658-aebafb9b2068 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Aug 22 16:12:17.348029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 620/1258] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:17.693698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:17.694288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:17.700702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:17.701175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:17.701605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:17.702287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:17.702737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:17.703156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:17.770064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:17.778186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-94db38c0-586e-41b2-b30b-538c94460621 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088274 Aug 22 16:12:17.778758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 639/1259] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:17 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:18.364683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:18.371374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:18.378788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:18.379358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:18.379951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:18.380814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:18.381393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:18.381925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:18.410614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9289d8ec-6520-447f-b8a4-d74d718adeba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054286 Aug 22 16:12:18.411166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 621/1260] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:12:18.799130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:18.799708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:18.806103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:18.806586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:18.807027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:18.808277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:18.808730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:18.809157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:18.869398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:18.877682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6795ab81-2e62-4c9c-a75a-93efa4b4f38a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082518 Aug 22 16:12:18.878250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 640/1261] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:18 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:19.422723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:19.424900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:19.431436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:19.431922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:19.432358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:19.433050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:19.433500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:19.434440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:19.464274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-925ad215-9eb2-4fd2-a63a-483afcedde73 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045520 Aug 22 16:12:19.464835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 622/1262] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:19.898926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:19.899566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:19.906024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:19.906519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:19.906957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:19.907685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:19.908143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:19.908570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:19.970687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:19.978512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cfc52758-b385-4408-b077-99623d4619d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083513 Aug 22 16:12:19.979076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 641/1263] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:19 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:20.475951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:20.478114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:20.485023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:20.485498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:20.485931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:20.486616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:20.487071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:20.487523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:20.512040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:20.517604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2591d860-2300-4015-adc4-6bd37cb7a56a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Aug 22 16:12:20.518166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 623/1264] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:20.999005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:20.999754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:21.006304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:21.006790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:21.007232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:21.007969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:21.008554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:21.008846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:21.069823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:21.077569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-31a4b7fb-ce07-4138-afe1-746dd4b1e401 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082458 Aug 22 16:12:21.078135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 642/1265] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:20 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:21.529899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:21.532131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:21.538525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:21.539008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:21.539471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:21.540166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:21.540619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:21.541043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:21.569994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a824a1ce-13f0-41a8-8d01-1aef94ca16fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Aug 22 16:12:21.570581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 624/1266] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:22.098129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:22.098751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:22.105233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:22.106224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:22.106668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:22.107386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:22.107878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:22.108307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:22.171489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:22.183628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-97ac2fa7-66b7-4f4d-b7ff-3c8745f3cf9b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086358 Aug 22 16:12:22.183628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 643/1267] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:22 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:22.582269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:22.584457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:22.590840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:22.591611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:22.592042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:22.592769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:22.593211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:22.593625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:22.622594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d3deb82b-6b3d-4767-9f1c-42db7ec9e347 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Aug 22 16:12:22.623158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 625/1268] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:22.884355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:12:22.884619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:12:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:12:23.212028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:23.212575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:23.219817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:23.220300 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:23.220735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:23.221428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:23.221883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:23.222306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:23.283104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:23.290918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-00aa64f6-2b34-4749-9025-76965a8ca80d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082829 Aug 22 16:12:23.291507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 644/1269] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:23 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:23.634904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:23.637675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:23.644161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:23.644644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:23.645081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:23.645775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:23.646228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:23.646654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:23.679848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d77a8589-f6d1-4d3f-b644-32000245384b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048912 Aug 22 16:12:23.680731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 626/1270] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:24.312367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:24.313019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:24.319513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:24.319995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:24.320431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:24.321124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:24.321579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:24.322004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:24.383146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:24.391633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0526735e-a546-4f30-9acd-32ec817289db tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083774 Aug 22 16:12:24.392271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 645/1271] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:24 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:24.691896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:24.694012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:24.701095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:24.701575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:24.702013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:24.702728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:24.703184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:24.703646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:24.733184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-87a6afae-07b8-46c7-a24e-1d0187b2d2f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Aug 22 16:12:24.733835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 627/1272] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:25.413708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:25.414305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:25.421388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:25.421869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:25.422304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:25.422994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:25.423475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:25.423898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:25.486498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:25.494232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ee50eaf7-2c2a-4612-9377-484212a678c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084433 Aug 22 16:12:25.494785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 646/1273] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:25 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:25.745894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:25.748644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:25.755090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:25.755599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:25.756034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:25.756717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:25.757164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:25.757585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:25.786096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b0bde671-28c3-4890-855c-58a074648c50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Aug 22 16:12:25.786655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 628/1274] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:26.515167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:26.515893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:26.522186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:26.522660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:26.523113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:26.523825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:26.524274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:26.524697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:26.588340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:26.596947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-092cec46-a03e-4df2-b5d6-87630f391246 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086133 Aug 22 16:12:26.597501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 647/1275] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:26 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:26.798523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:26.800650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:26.807072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:26.807579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:26.808045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:26.809251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:26.809707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:26.810131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:26.838860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-afd86920-5dfe-4be4-ad4a-c8ff241ff29b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Aug 22 16:12:26.839429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 629/1276] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:27.617426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:27.618134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:27.624956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:27.625435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:27.625871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:27.626562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:27.627020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:27.627476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:27.688226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:27.695876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e99233bd-0693-47cc-a78e-e2003b3821d5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082316 Aug 22 16:12:27.696437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 648/1277] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:27 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:27.851622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:27.853807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:27.860759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:27.861243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:27.861683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:27.862380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:27.862834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:27.863258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:27.892387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e5e787c0-7595-4eb9-aabd-5efe4fe5aba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 Aug 22 16:12:27.892922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 630/1278] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:28.717633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:28.718298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:28.724744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:28.725224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:28.725658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:28.726347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:28.726797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:28.727217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:28.788466 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:28.796867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c7c47e09-2141-4b30-bfc6-bd1c383a66fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083333 Aug 22 16:12:28.797376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 649/1279] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:28 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:28.908890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:28.911064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:28.917364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:28.917843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:28.918277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:28.918998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:28.919990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:28.920424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:28.949250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-89c3ae40-5458-4407-8457-ead18e67c585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047661 Aug 22 16:12:28.949799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 631/1280] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:29.817388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:29.818036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:29.824457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:29.824931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:29.825366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:29.826055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:29.826555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:29.826978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:29.842125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:29.888248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:29.896019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-975d1eeb-7074-40b7-800c-6c5a4a07e6d3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082487 Aug 22 16:12:29.896594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 650/1281] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:29 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:29.961480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:29.963680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:29.970643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:29.971127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:29.971599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:29.972298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:29.972753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:29.973180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:30.001942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f04ba91c-47c3-4478-8ef7-a1e6ec21b31a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Aug 22 16:12:30.002499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 632/1282] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:30.917110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:30.917704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:30.924104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:30.924589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:30.925022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:30.925717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:30.926170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:30.926592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:30.991088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:30.999440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-02a6040c-95cb-4ee0-8f1f-5e067a3b406d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086140 Aug 22 16:12:31.000005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 651/1283] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:30 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:31.014112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:31.016334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:31.022676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:31.023148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:31.023611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:31.024290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:31.024734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:31.025146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:31.053889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-87c0e1d1-070f-401d-8e4d-993f1087023c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Aug 22 16:12:31.054447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 633/1284] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:32.020405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:32.021016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:32.027618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:32.028010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:32.028441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:32.029152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:32.029603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:32.030018 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:32.067697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:32.070044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:32.077112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:32.077601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:32.078037 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:32.078804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:32.079263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:32.079721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:32.095370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:32.104304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6c621033-5a33-498b-8c3a-c9b179063524 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087761 Aug 22 16:12:32.104875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 652/1285] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:32 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:32.111263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3d58ab91-577e-48f5-96f3-a651055e7395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048409 Aug 22 16:12:32.111858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 634/1286] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:12:33.123837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:33.124780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:33.125396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:33.125993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:33.131801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:33.132274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:33.132385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:33.132716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:33.132845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:33.133203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:33.133566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:33.133860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:33.133978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:33.134282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:33.134391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:33.134750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:33.166402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e5604bf9-8ce6-4c9e-8d09-62f9e33eaba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Aug 22 16:12:33.166966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 653/1287] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:33.196371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:33.204591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5024c78b-5c19-41ea-aba8-e600d8fdf18e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083635 Aug 22 16:12:33.205156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 635/1288] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:33 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:12:34.178279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:34.180472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:34.186954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:34.187467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:34.187913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:34.188606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:34.189060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:34.189488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:34.220393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-caaee0a6-71fb-4ee5-89c2-90ab4877abed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Aug 22 16:12:34.220964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 654/1289] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:34.227352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:34.227991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:34.235774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:34.236262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:34.236700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:34.237405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:34.237858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:34.238283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:34.301493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:34.309070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-90a1e736-e16e-4dd8-a008-ea4744839e64 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085555 Aug 22 16:12:34.309627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 636/1290] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:34 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:35.232760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:35.234945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:35.241469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:35.241952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:35.242394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:35.243090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:35.243593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:35.244022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:35.274820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e250be17-b168-4d1c-b6aa-454673dace5c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046043 Aug 22 16:12:35.275411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 655/1291] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:35.330337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:35.330955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:35.337334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:35.337808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:35.338234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:35.338911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:35.339379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:35.339800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:35.404484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:35.412258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a76f92d4-f0cc-4e6d-b4fc-c65d67a342e4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086396 Aug 22 16:12:35.412823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 637/1292] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:35 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:36.287710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:36.289794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:36.296226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:36.296708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:36.297154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:36.297846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:36.298304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:36.298731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:36.327169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cb769227-fddb-4936-a335-67c090c1585b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Aug 22 16:12:36.327967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 656/1293] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:36.433602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:36.434320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:36.440871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:36.441440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:36.441875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:36.442572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:36.443022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:36.443471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:36.506097 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:36.513857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e130a8b8-fbeb-40b2-8d7d-369f9c3f50b2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084090 Aug 22 16:12:36.514416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 638/1294] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:36 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:37.340293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:37.343199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:37.345527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=56 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:37.351097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:37.351608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:37.352051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:37.352747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:37.353232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:37.353659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:37.382982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-65e3e3e4-41fb-48ad-a8bd-9db7210e94a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 Aug 22 16:12:37.383635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 657/1295] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:37.534572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:37.535215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:37.541779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:37.542266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:37.542701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:37.543431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:37.543888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:37.544312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:37.612706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:37.621254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ad529ed2-16ae-46bf-8d44-b735998313a0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091028 Aug 22 16:12:37.621874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 639/1296] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:37 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:38.396164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:38.398310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:38.404717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:38.405202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:38.405644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:38.406443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:38.407553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:38.407998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:38.435682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a1a6d2a3-fbb4-47d1-ad62-680f7ce86fd5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043464 Aug 22 16:12:38.436316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 658/1297] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:38.642484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:38.643087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:38.645402 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=58 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:38.650878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:38.651280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:38.651797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:38.652426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:38.652868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:38.653284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:38.674128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:38.731152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:38.739570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e5265464-6c14-4390-8f9b-bc19363d15c3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.101382 Aug 22 16:12:38.740126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 640/1298] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:38 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:39.448281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:39.450405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:39.456970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:39.457445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:39.457880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:39.458603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:39.459005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:39.459453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:39.489481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b41e5eee-ba24-4e9c-a951-145b0fe7246a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Aug 22 16:12:39.490078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 659/1299] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:39.762746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:39.763303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:39.770405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:39.770884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:39.771314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:39.772030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:39.772474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:39.772896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:39.836700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:39.845408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bd0488c3-9a8f-4460-a97e-ffeaafba3c35 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089024 Aug 22 16:12:39.845970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 641/1300] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:39 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:40.502538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:40.504797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:40.511303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:40.511808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:40.512247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:40.512943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:40.513386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:40.513806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:40.544365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fc493aa2-3bc5-448e-934b-b8590b3a504c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046874 Aug 22 16:12:40.544925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 660/1301] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:40.866582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:40.867199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:40.873805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:40.874287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:40.874744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:40.876128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:40.876617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:40.877218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:40.940190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:40.947814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-314afb3d-d528-4498-ba7d-dcbc67dc3f41 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085098 Aug 22 16:12:40.948377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 642/1302] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:40 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:41.557291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:41.559589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:41.566548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:41.567025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:41.567489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:41.568178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:41.568628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:41.569048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:41.597470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-426c892c-ad1f-4974-beb6-59e8ee8c18e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Aug 22 16:12:41.598021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 661/1303] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:41.969900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:41.970513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:41.977155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:41.977642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:41.978076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:41.978771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:41.979225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:41.979695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:42.041410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:42.050036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bc87c522-3266-444a-9cc5-553452f2d13d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084915 Aug 22 16:12:42.050591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 643/1304] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:41 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:42.608967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:42.611618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:42.618694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:42.619225 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:42.619683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:42.620389 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:42.620845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:42.621271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:42.651848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3258bc62-a177-419f-8b05-0b14aaea7e7a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Aug 22 16:12:42.652400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 662/1305] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:43.070537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:43.071164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:43.077480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:43.077952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:43.078385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:43.079070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:43.079553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:43.079969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:43.141740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:43.149789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5dcb1c4a-2b28-451b-bd29-71958f3361a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083102 Aug 22 16:12:43.150355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 644/1306] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:43 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:43.665159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:43.667304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:43.673450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:43.673933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:43.674371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:43.675067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:43.675565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:43.675994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:43.705660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-313bc1d9-fff9-4c9a-b428-288bf23b7ce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Aug 22 16:12:43.706218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 663/1307] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:44.170948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:44.171532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:44.178379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:44.178851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:44.179277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:44.179981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:44.180425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:44.180844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:44.245444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:44.253866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e33ad331-7215-4e0d-a7f0-6180f75598ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086871 Aug 22 16:12:44.254427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 645/1308] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:44 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:44.718345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:44.720452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:44.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:44.727400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:44.727842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:44.728541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:44.728998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:44.729425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:44.759638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2931d1ca-859d-4c33-952e-74889881360a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Aug 22 16:12:44.760220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 664/1309] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:45.274234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:45.274853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:45.281320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:45.282313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:45.282749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:45.283471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:45.283925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:45.284349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:45.573206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:45.581504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2eaf81f3-ef75-44d3-af10-462557017333 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.311191 Aug 22 16:12:45.582069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 646/1310] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:45 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:45.771547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:45.773719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:45.780172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:45.780653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:45.781088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:45.782369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:45.782820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:45.783248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:45.812265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1db1e2c6-ed32-4dbb-9b68-6593269b6728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Aug 22 16:12:45.813360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 665/1311] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:46.602350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:46.603029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:46.609225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:46.609707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:46.610139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:46.610833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:46.611293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:46.611731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:46.674966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:46.682717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d8b22796-50f0-42dc-97f0-b0d58e60801c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084485 Aug 22 16:12:46.683289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 647/1312] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:46 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:46.824863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:46.827023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:46.834074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:46.834547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:46.834973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:46.835694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:46.836138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:46.836555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:46.864973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af0a6080-459f-4f86-b979-b7b0c2e085f3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Aug 22 16:12:46.865535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 666/1313] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:47.705153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:47.705753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:47.712252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:47.712731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:47.713170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:47.713866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:47.714320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:47.714754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:47.777538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:47.786257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5474d3d4-3564-400a-b9dc-fdb9553e1954 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084920 Aug 22 16:12:47.786843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 648/1314] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:47 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:47.877042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:47.879228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:47.885733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:47.886218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:47.886656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:47.887371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:47.887829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:47.888260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:47.890624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:47.918921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-49d3c933-e775-4242-89d8-81a78f98d404 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046491 Aug 22 16:12:47.919510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 667/1315] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:48.807595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:48.808145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:48.815147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:48.815659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:48.816103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:48.816826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:48.817285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:48.817716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:48.878371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:48.886215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-324b2027-ef73-4c89-ad98-5e15820a7618 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082639 Aug 22 16:12:48.886783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 649/1316] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:48 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:48.931307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:48.933669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:48.940543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:48.941020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:48.941449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:48.942132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:48.942577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:48.942996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:48.971638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-05a8eef6-2a4d-4a38-883e-489935c1052b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Aug 22 16:12:48.972244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 668/1317] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:49.907274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:49.907906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:49.914342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:49.914817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:49.915247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:49.915957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:49.916406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:49.916833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:49.980016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:49.984034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:49.986737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:49.988459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f4480273-26e3-4ff2-bee5-b542231803e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085015 Aug 22 16:12:49.989031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 650/1318] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:49 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:49.993449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:49.993937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:49.994377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:49.995083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:49.995562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:49.995991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:50.026174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a146d37d-7f3c-44eb-9077-5c15dcbfb9d9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046001 Aug 22 16:12:50.026891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 669/1319] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:12:51.009699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:51.010317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:51.016952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:51.017433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:51.017870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:51.019203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:51.019685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:51.020111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:51.039103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:51.042048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:51.048669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:51.049153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:51.049592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:51.050288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:51.050744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:51.051165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:51.081389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:51.081817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-971e3b1b-779e-4e91-8134-401cddcd6470 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047320 Aug 22 16:12:51.082376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 670/1320] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:51.089471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9bd56ede-ac3d-4316-b38b-ebd748110853 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083668 Aug 22 16:12:51.090141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 651/1321] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:51 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:52.094493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:52.096741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:52.103404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:52.103892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:52.104334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:52.105036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:52.105491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:52.105920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:52.110153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:52.110811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:52.117132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:52.117605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:52.118033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:52.118720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:52.119227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:52.119676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:52.135936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-77044557-bced-48e8-b9a6-81f63cd1bda7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045627 Aug 22 16:12:52.136789 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 671/1322] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:52.181546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:52.189232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0c2ea800-acb0-402b-b79a-1131cd2e488f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083040 Aug 22 16:12:52.190412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 652/1323] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:52 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:12:53.148552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:53.150684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:53.157877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:53.158358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:53.158886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:53.159621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:53.160071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:53.160493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:53.189723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-87e9e2d7-365a-46c0-94f7-14a4cca7a003 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Aug 22 16:12:53.190988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 672/1324] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:53.209755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:53.210373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:53.217145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:53.217623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:53.218059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:53.218740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:53.219189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:53.219658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:53.282995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:53.291300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8264e36b-e5f6-47cf-86c5-41d164286ddd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085303 Aug 22 16:12:53.291881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 653/1325] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:53 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:54.202221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:54.204387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:54.211496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:54.211975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:54.212405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:54.213091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:54.213544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:54.213963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:54.243691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3eca0639-a558-4879-9ce7-42117198c3b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Aug 22 16:12:54.244253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 673/1326] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:54.312320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:54.312980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:54.319951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:54.320428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:54.320855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:54.321530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:54.321973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:54.322388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:54.386677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:54.395619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e8cca30-bc25-4b77-a7a4-95b921d826d4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087036 Aug 22 16:12:54.396192 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 654/1327] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:54 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:55.256371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:55.258531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:55.265035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:55.265511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:55.265948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:55.266642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:55.267096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:55.267554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:55.297290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a5447ad8-662f-4ffa-84ac-85c639dbf69c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045491 Aug 22 16:12:55.297759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 674/1328] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:55.415901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:55.416513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:55.422910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:55.423426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:55.423868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:55.425080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:55.425532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:55.425958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:55.488423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:55.497470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c463d267-2c37-4cc7-885f-7b02473a9595 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085389 Aug 22 16:12:55.498040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 655/1329] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:55 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:56.309594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:56.312005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:56.319011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:56.319547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:56.319990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:56.320679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:56.321124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:56.321546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:56.351661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ef77a330-392a-4ceb-878d-c772fe9f3c83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046353 Aug 22 16:12:56.352224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 675/1330] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:56.518706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:56.519318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:56.525852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:56.526333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:56.526768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:56.527509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:56.527965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:56.528387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:56.592559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:56.601004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f1b1294c-3f82-48c3-9fd5-ae6d53636093 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086788 Aug 22 16:12:56.601577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 656/1331] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:56 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:57.366794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:57.368970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:57.375516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:57.375993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:57.376425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:57.377625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:57.378087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:57.378501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:57.408962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3d490401-bbcd-4056-af68-4dafed152ea5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Aug 22 16:12:57.409536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 676/1332] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:57.622350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:57.623039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:57.629581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:57.630049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:57.630476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:57.631159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:57.631638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:57.632054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:57.634628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:57.695072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:57.702936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7a6955ea-2147-47b7-bdc2-6457d017e04c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084579 Aug 22 16:12:57.703539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 657/1333] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:57 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:58.421399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:58.423571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:58.430486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:58.430959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:58.431424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:58.432106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:58.432551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:58.432965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:58.462069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-52eafc9c-5d7c-4982-8b28-c43ed1490984 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Aug 22 16:12:58.462621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 677/1334] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:58.727375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:58.727999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:58.734961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:58.735478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:58.735912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:58.736666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:58.737634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:58.738052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:58.804824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:58.812685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d387ea10-7422-4004-8aae-41507c806637 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089620 Aug 22 16:12:58.813256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 658/1335] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:58 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:12:59.474360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:59.476451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:59.482881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:59.483404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:59.483846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:59.484585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:59.485030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:59.485455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:59.515003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5726f365-792b-441f-a066-38391210c2d0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Aug 22 16:12:59.515599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 678/1336] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:12:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:12:59.834690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:12:59.835302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:12:59.841769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:59.842498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:59.842930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:59.843659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:12:59.844108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:12:59.844529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:12:59.906258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:12:59.914705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a550eadf-a450-4197-8138-cbc826e64be9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084385 Aug 22 16:12:59.915266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 659/1337] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:12:59 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:00.528040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:00.530238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:00.537186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:00.537661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:00.538108 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:00.538798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:00.539242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:00.540135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:00.569297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dca7a471-13a9-4b1c-862f-3af767826f25 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Aug 22 16:13:00.569847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 679/1338] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:00.935798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:00.936434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:00.943316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:00.943816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:00.944243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:00.944945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:00.945372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:00.945788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:01.008319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:01.015960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b7bafa0f-a162-4203-b588-cdf156e99002 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084082 Aug 22 16:13:01.016513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 660/1339] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:00 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:01.581836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:01.584050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:01.590380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:01.590859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:01.591297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:01.592274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:01.592725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:01.593145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:01.623091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-631d09fe-d182-449d-ab12-a5075486101f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Aug 22 16:13:01.623678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 680/1340] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:02.037646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:02.038253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:02.044621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:02.045093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:02.045520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:02.046231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:02.046676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:02.047091 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:02.107907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:02.116092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0afacc2f-bda7-47fd-b35d-ef49d2e76921 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082921 Aug 22 16:13:02.116647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 661/1341] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:02 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:02.636116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:02.638266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:02.645460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:02.645942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:02.646377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:02.647064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:02.647558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:02.647983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:02.677235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2e566ed1-5569-49d5-bfe5-fe42a5f1e796 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Aug 22 16:13:02.677799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 681/1342] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:03.137479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:03.138230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:03.145475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:03.145957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:03.146399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:03.147098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:03.147585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:03.148015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:03.211726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:03.219736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-65634395-7366-4f9f-927f-b0f1eea4c438 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086128 Aug 22 16:13:03.220306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 662/1343] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:03 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:03.690591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:03.692795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:03.699796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:03.700280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:03.700720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:03.701408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:03.701865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:03.702291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:03.731213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fc918d16-31e7-4862-b149-d6327561e3c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Aug 22 16:13:03.731960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 682/1344] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:04.241117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:04.241725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:04.247908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:04.248387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:04.248813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:04.249506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:04.249948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:04.250361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:04.310851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:04.319038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0e0f159e-dd24-48cf-b902-99b07861065b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082830 Aug 22 16:13:04.319634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 663/1345] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:04 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:04.744516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:04.746689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:04.753390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:04.753878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:04.754318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:04.755047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:04.755539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:04.755967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:04.780753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:04.787682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-19416db9-9d5a-4fb2-979d-5743dec146e4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Aug 22 16:13:04.787682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 683/1346] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:05.339880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:05.340408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:05.347651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:05.348134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:05.348573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:05.349263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:05.349718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:05.350140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:05.410362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:05.418125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b902483b-3b4a-4d62-a70c-9eb19d3617b7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082282 Aug 22 16:13:05.418691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 664/1347] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:05 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:05.799405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:05.801508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:05.808092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:05.808565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:05.808993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:05.809672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:05.810118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:05.810539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:05.838964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e061b115-a7a9-4596-a6dd-aaab55c173fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043594 Aug 22 16:13:05.839534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 684/1348] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:06.439539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:06.440159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:06.446603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:06.447081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:06.447565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:06.448259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:06.448711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:06.449136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:06.509771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:06.517575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-79800b78-5f4e-4888-83eb-64ae8d1c2180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082011 Aug 22 16:13:06.518649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 665/1349] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:06 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:06.851463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:06.853594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:06.860000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:06.860479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:06.860909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:06.861591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:06.862038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:06.862455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:06.891434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3aa7eb41-dfd9-4f3f-ae1e-66bd8900ff96 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Aug 22 16:13:06.891986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 685/1350] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:07.538907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:07.539584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:07.545983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:07.546475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:07.546901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:07.547619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:07.548076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:07.548502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:07.616071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:07.623721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3e0afac5-ac3d-4cbf-bf08-3ae314f47706 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088647 Aug 22 16:13:07.624278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 666/1351] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:07 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:13:07.904478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:07.906624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:07.909146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=58 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:07.916004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:07.916492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:07.916960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:07.917664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:07.918119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:07.918545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:07.948351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b718d0cd-2e73-4078-9ce9-5333efcdc6ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047902 Aug 22 16:13:07.948911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 686/1352] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:08.645183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:08.645835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:08.652977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:08.653463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:08.653895 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:08.654585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:08.655033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:08.655491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:08.718598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:08.727040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-55741e68-d52b-4172-994e-9af1de3e1971 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086658 Aug 22 16:13:08.727659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 667/1353] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:08 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:08.961257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:08.963458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:08.972121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:08.972609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:08.973052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:08.973790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:08.974250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:08.974673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:09.003987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-98958671-e4d2-40da-8770-9e9db0a7a840 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Aug 22 16:13:09.004543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 687/1354] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:09.748343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:09.748956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:09.751233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=56 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:09.757089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:09.757564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:09.757993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:09.758673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:09.759119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:09.759569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:09.822682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:09.831295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2fb541c6-7204-40a0-8631-f5413807ab9d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086054 Aug 22 16:13:09.831942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 668/1355] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:09 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:10.016342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:10.018520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:10.024986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:10.025472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:10.025910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:10.026609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:10.027069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:10.027512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:10.057837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fe242fcf-aa7a-4478-957d-4f6297452e55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 Aug 22 16:13:10.058410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 688/1356] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:10.852649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:10.853263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:10.859716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:10.860206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:10.860644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:10.861342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:10.862304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:10.862733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:10.925494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:10.933138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2336b583-dfb5-4ecd-824c-fcdd747ea762 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084342 Aug 22 16:13:10.933698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 669/1357] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:10 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:13:11.070102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:11.072284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:11.078564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:11.079042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:11.079513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:11.080195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:11.081145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:11.081561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:11.110144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d16fba31-577f-41d3-885d-4a573f066d7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 22 16:13:11.110611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 689/1358] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:11.954273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:11.954914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:11.962231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:11.962711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:11.963146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:11.963890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:11.964332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:11.964754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:12.029364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:12.037887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-821ef436-b9d4-4a0a-9c7d-2b368640eaa3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087461 Aug 22 16:13:12.038457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 670/1359] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:11 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:12.122182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:12.124350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:12.131431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:12.131915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:12.132352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:12.133045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:12.133498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:12.133922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:12.162940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e5b93460-225c-4cc7-b8c4-1a776a88ebf9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 Aug 22 16:13:12.163524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 690/1360] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:13.059972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:13.060974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:13.068998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:13.069488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:13.070207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:13.070925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:13.071406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:13.071839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:13.138569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:13.146998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c59dc83a-6f28-4137-b722-910d2b6266a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.092574 Aug 22 16:13:13.147603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 671/1361] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:13 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:13.279873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:13.282090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:13.288820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:13.289300 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:13.289730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:13.290422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:13.290871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:13.291289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:13.319762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cc2d48bb-94ce-411d-bccd-aadaccb2bb2b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149079 Aug 22 16:13:13.320326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 691/1362] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:14.168967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:14.169563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:14.176154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:14.176631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:14.177070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:14.177764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:14.178221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:14.178643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:14.239620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:14.247486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5acfad89-4423-4b57-82ba-7cac6373807f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082384 Aug 22 16:13:14.248316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 672/1363] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:14 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:14.333343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:14.335552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:14.342322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:14.342798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:14.343229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:14.343946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:14.344397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:14.344850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:14.373762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0eca92fc-50da-48c0-87e5-f215bd4bbd0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Aug 22 16:13:14.374309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 692/1364] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:15.269997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:15.270603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:15.277042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:15.277517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:15.277951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:15.278649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:15.279098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:15.279559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:15.341681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:15.344160 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:15.351290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3b1bca10-3fd7-44e8-81b1-cd4fad85f558 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085730 Aug 22 16:13:15.351882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 673/1365] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:15 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:15.386055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:15.388221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:15.394656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:15.395142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:15.395625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:15.396319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:15.396774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:15.397200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:15.425308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-926ce1cc-211e-4ddf-90c9-5b8ef7f640f2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Aug 22 16:13:15.426375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 693/1366] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:16.372509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:16.373117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:16.380419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:16.380898 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:16.381332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:16.382016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:16.382466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:16.382884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:16.438130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:16.440420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:16.446940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:16.448262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:16.448747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:16.449381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:16.450091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:16.450545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:16.451004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:16.454809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-32a58325-2834-40d0-926c-53cfea944add tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086276 Aug 22 16:13:16.455398 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 674/1367] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:16 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:13:16.480619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0982688e-308c-480f-9d1e-ad18a2223804 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046449 Aug 22 16:13:16.481175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 694/1368] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:13:17.476014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:17.476621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:17.482920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:17.483430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:17.483860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:17.484535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:17.485017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:17.485393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:17.493168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:17.495410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:17.501841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:17.502324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:17.502771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:17.503509 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:17.503976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:17.504404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:17.534460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ce1ae669-ca72-432b-8c31-280ad9b25a4a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045100 Aug 22 16:13:17.535833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 695/1369] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:17.547665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:17.555996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b5f44608-0c35-4479-b43a-45dce3c321e5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084371 Aug 22 16:13:17.556557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 675/1370] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:17 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:18.547274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:18.549453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:18.555917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:18.556701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:18.556930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:18.557505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:18.557960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:18.558387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:18.576378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:18.576982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:18.584120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:18.584793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:18.585368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:18.586235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:18.586940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:18.587545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:18.588401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1c62cbfa-5ffa-4bdc-858e-3d4086f50ea7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Aug 22 16:13:18.593528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 696/1371] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:18.652057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:18.660713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9513df47-d43b-44dd-81ec-7ff7da6948c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087484 Aug 22 16:13:18.661274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 676/1372] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:18 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:13:19.600836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:19.603011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:19.609430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:19.609912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:19.610354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:19.611090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:19.611564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:19.611990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:19.640841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-412080b6-85bd-4b10-8719-3424c0260283 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Aug 22 16:13:19.641394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 697/1373] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:19.681604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:19.682214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:19.688627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:19.689101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:19.689529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:19.690215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:19.690668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:19.691090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:19.753236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:19.760927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-20d8800e-61cc-484e-bac1-83833fcfa50c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083208 Aug 22 16:13:19.761478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 677/1374] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:19 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:20.653133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:20.655347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:20.662765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:20.663319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:20.663782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:20.664793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:20.665258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:20.665687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:20.694280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-393fe00f-e098-4e2c-a948-6916f5d40d5e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Aug 22 16:13:20.694852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 698/1375] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:20.781838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:20.782456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:20.789657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:20.790207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:20.790589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:20.791291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:20.791789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:20.792217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:20.856450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:20.864153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cadfcc15-9ccf-45f3-9323-4e6cd8361c8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086244 Aug 22 16:13:20.864716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 678/1376] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:20 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:21.706725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:21.708933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:21.715344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:21.715841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:21.716281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:21.717009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:21.717733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:21.718164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:21.748935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bd4d64a2-053a-484e-928f-74816f39b991 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046178 Aug 22 16:13:21.749500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 699/1377] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:21.884149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:21.884737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:21.891057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:21.891564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:21.891993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:21.892670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:21.893118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:21.893534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:21.956590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:21.964264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c5368b77-3055-4470-84bf-5b25e3fdd19f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084009 Aug 22 16:13:21.964820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 679/1378] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:21 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:22.760824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:22.762993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:22.769732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:22.770216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:22.770648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:22.771435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:22.771889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:22.772311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:22.787515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:22.804518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9e230469-0a65-4579-89fd-9f42caa481b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047667 Aug 22 16:13:22.805011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 700/1379] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:22.985567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:22.986157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:22.992720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:22.993190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:22.993617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:22.994293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:22.994739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:22.995154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:23.057261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:23.064807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ef544d57-6d30-4018-805e-346d5b1f0f22 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083113 Aug 22 16:13:23.065360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 680/1380] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:22 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:13:23.816631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:23.818787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:23.825352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:23.825834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:23.826283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:23.826982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:23.827468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:23.827900 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:23.856577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6afef80b-9ae3-4adb-8bac-8720c6d95e85 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 Aug 22 16:13:23.857133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 701/1381] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:24.085496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:24.086044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:24.092777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:24.093264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:24.093700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:24.094391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:24.094846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:24.095273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:24.156804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:24.165127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b4711bbf-0164-48ee-a677-9903bc1c1161 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083713 Aug 22 16:13:24.165680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 681/1382] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:24 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:13:24.869675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:24.871912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:24.878506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:24.878982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:24.879464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:24.880192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:24.880679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:24.881105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:24.910943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5e14fe1b-5b78-4428-b6ce-facd13272346 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Aug 22 16:13:24.911551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 702/1383] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:25.185576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:25.186131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:25.192723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:25.193206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:25.193645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:25.194387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:25.194844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:25.195272 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:25.262669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:25.271610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-783e2fda-a0c6-4f64-b346-30aea2eb8744 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089991 Aug 22 16:13:25.272183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 682/1384] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:25 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:25.923295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:25.925450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:25.931866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:25.932366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:25.932795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:25.933478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:25.933924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:25.934341 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:25.964087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a44142e6-7e3a-4fe6-a7b2-4384a061a582 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Aug 22 16:13:25.964639 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 703/1385] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:26.292522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:26.293132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:26.299497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:26.299997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:26.300415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:26.301105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:26.301563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:26.301985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:26.363845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:26.372118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-598364b9-8cab-4db8-9747-c82257a9ca7b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083658 Aug 22 16:13:26.372683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 683/1386] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:26 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:26.977208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:26.979391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:26.985794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:26.986277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:26.986715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:26.987434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:26.987896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:26.988322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:27.017509 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dfec10d9-892f-42d6-a619-351336135e81 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Aug 22 16:13:27.018066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 704/1387] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:27.393335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:27.394055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:27.400699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:27.401181 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:27.401608 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:27.402289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:27.402732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:27.403146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:27.464161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:27.472798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1e4fef02-c8f3-455e-b54e-fb65b5f16b7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082688 Aug 22 16:13:27.473386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 684/1388] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:27 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:28.030454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:28.032614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:28.039042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:28.039618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:28.040053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:28.040741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:28.041185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:28.041600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:28.069980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dddbd9f5-62a6-4f38-8950-c9fc0248b687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Aug 22 16:13:28.070525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 705/1389] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:28.494048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:28.494673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:28.501108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:28.501593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:28.502038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:28.502744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:28.503199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:28.503658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:28.566269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:28.573965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2501c552-4176-4cba-a5a9-319b27340b2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083834 Aug 22 16:13:28.574528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 685/1390] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:28 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:29.083082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:29.085648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:29.092695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:29.093175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:29.093613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:29.094309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:29.094763 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:29.095186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:29.127162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-40578817-1c30-4f98-8879-f950c493b409 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048602 Aug 22 16:13:29.128236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 706/1391] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:29.594347 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:29.594989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:29.602439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:29.602921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:29.603375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:29.604071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:29.604520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:29.604940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:29.671948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:29.680911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-27dbe012-f8ef-4f4a-ac68-cd3e027541fe tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090665 Aug 22 16:13:29.681484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 686/1392] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:29 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:30.140902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:30.143076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:30.150017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:30.150492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:30.150926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:30.151634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:30.152084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:30.152501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:30.180354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e95e4ca-cefa-4b81-91e7-4c491aece570 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Aug 22 16:13:30.180896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 707/1393] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:30.701483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:30.702289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:30.708880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:30.709368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:30.709814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:30.710507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:30.710946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:30.711384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:30.773671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:30.781517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-676ab22f-5e52-4689-b611-b05abf21c063 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083946 Aug 22 16:13:30.782085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 687/1394] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:30 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:31.192355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:31.194421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:31.200755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:31.201235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:31.201674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:31.202357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:31.202810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:31.203233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:31.232637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5f72739d-992a-452c-8d26-60c87d7833bb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Aug 22 16:13:31.233189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 708/1395] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:31.803230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:31.803951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:31.810170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:31.810656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:31.811093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:31.811823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:31.812283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:31.812709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:31.875189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:31.883560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ef23c5d2-7ac1-4543-98c9-7a5bd6f135cb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084277 Aug 22 16:13:31.884133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 688/1396] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:31 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:32.245647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:32.247838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:32.254274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:32.254755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:32.255183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:32.255969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:32.256368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:32.256792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:32.285939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5f36c418-e104-4cdc-b928-6d3ad27a3661 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Aug 22 16:13:32.286501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 709/1397] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:32.904383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:32.905267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:32.912153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:32.912624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:32.913057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:32.913743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:32.914191 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:32.914612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:32.975966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:32.983705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-76c4db14-fcb8-4e80-9b74-deaa67c9cdcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083199 Aug 22 16:13:32.984267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 689/1398] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:32 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:33.297889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:33.299990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:33.307131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:33.307648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:33.308091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:33.308801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:33.309261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:33.309690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:33.339113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4735ed5f-6a1a-47a3-ad1e-82809f7ee3cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Aug 22 16:13:33.339712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 710/1399] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:13:34.004152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:34.005297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:34.011726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:34.012207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:34.012641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:34.013331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:34.013787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:34.014214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:34.029275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:34.079036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:34.086944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-274cde32-70f1-4b08-bde0-2aabc4717269 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086665 Aug 22 16:13:34.087540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 690/1400] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:33 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:34.351817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:34.354229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:34.360717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:34.361197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:34.361627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:34.362305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:34.362749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:34.363186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:34.394572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-275dc432-0945-43aa-8556-f76f1cd24554 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046719 Aug 22 16:13:34.395206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 711/1401] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:35.107878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:35.108507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:35.115139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:35.115658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:35.116099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:35.116801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:35.117253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:35.117713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:35.179738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:35.187920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-effbaa88-fe98-4478-8fc6-687c9a61c1b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083850 Aug 22 16:13:35.188474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 691/1402] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:35 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:35.408003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:35.410112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:35.416678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:35.417163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:35.417603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:35.418325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:35.418784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:35.419210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:35.448815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f928d6ac-2b62-4acc-a01f-8a8a3d2c773a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Aug 22 16:13:35.449387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 712/1403] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:36.208523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:36.209141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:36.215841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:36.216322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:36.216763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:36.217718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:36.218171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:36.218599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:36.282485 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:36.290833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d4b002ac-2458-4a39-97c9-e083c28fac52 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086143 Aug 22 16:13:36.291349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 692/1404] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:36 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:36.461520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:36.463682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:36.470302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:36.471216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:36.471368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:36.471949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:36.472395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:36.472887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:36.501587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7b076317-fbfb-4a10-a2ad-ff348d81d256 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044522 Aug 22 16:13:36.502137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 713/1405] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:37.311873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:37.312475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:37.318893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:37.319394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:37.319831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:37.320524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:37.320974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:37.321393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:37.383290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:37.390958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c15b22ff-cfcd-4b98-b618-fc239c8b7f99 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082920 Aug 22 16:13:37.391648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 693/1406] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:37 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:37.514067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:37.516604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:37.523243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:37.523742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:37.524180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:37.524868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:37.525324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:37.525744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:37.554338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-43f6c91f-2528-4523-9140-29006090117b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Aug 22 16:13:37.554900 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 714/1407] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:38.412233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:38.412837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:38.419180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:38.419683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:38.420120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:38.420803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:38.421252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:38.421673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:38.486684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:38.494329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e824ca42-2de0-4e29-8a7b-19247785768a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086102 Aug 22 16:13:38.494885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 694/1408] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:38 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:38.566573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:38.569491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:38.571806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=58 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:38.577159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:38.577647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:38.578087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:38.578785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:38.579241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:38.579693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:38.609374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9b227ade-7108-4130-8a1b-aa94367f3ee3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046724 Aug 22 16:13:38.609941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 715/1409] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:39.515421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:39.516060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:39.522904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:39.523411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:39.523847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:39.524535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:39.524979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:39.525400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:39.586426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:39.594380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f84deb51-3e06-4517-acd7-0b64fa2d9c5a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082873 Aug 22 16:13:39.594936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 695/1410] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:39 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:39.621441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:39.623684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:39.630149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:39.630646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:39.631118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:39.631828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:39.632276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:39.632692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:39.662111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4847aeb3-8c58-4d2a-8d96-a3ef8e17020a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Aug 22 16:13:39.662669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 716/1411] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:40.616260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:40.617023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:40.620436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=56 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:40.624323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:40.624808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:40.625245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:40.625971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:40.626453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:40.626914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:40.674209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:40.676440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:40.682996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:40.683519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:40.683961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:40.684665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:40.685122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:40.685549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:40.689447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:40.696670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:40.707655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9aa475ec-3bd2-46bf-b2a0-a176286b9490 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.095434 Aug 22 16:13:40.708359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 696/1412] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:40 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:13:40.716983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fa514552-40eb-47be-8015-fafa954347e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Aug 22 16:13:40.717809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 717/1413] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:13:41.730190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:41.730881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:41.731278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:41.732735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:41.737465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:41.737957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:41.738399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:41.738764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:41.739160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:41.739295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:41.739645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:41.739781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:41.740073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:41.740378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:41.740835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:41.741263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:41.770187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-60b2fa99-9ec9-4238-b11e-6b0492db1938 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043412 Aug 22 16:13:41.770756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 697/1414] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:41.803607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:41.811405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-40ab387f-0eb8-4067-af51-833dd22434ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085045 Aug 22 16:13:41.812090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 718/1415] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:41 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:42.783279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:42.785415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:42.792506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:42.792992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:42.793428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:42.794131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:42.794582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:42.795010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:42.824644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-22b2fc3a-bb50-4596-bc73-515c25a4bdb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Aug 22 16:13:42.825207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 698/1416] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:42.832419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:42.833106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:42.839652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:42.840162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:42.840596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:42.841293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:42.841742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:42.842170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:42.906942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:42.915157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dc9d84b9-adb8-492a-96e8-001319d86702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086586 Aug 22 16:13:42.915743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 719/1417] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:42 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:43.837806 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:43.839970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:43.846687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:43.847163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:43.847624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:43.848306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:43.848747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:43.849162 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:43.878214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d7d5eeac-d3cc-4e04-adf8-d7203220e0fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Aug 22 16:13:43.878763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 699/1418] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:43.935582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:43.936218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:43.942323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:43.942808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:43.943245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:43.943964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:43.944422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:43.944848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:44.005685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:44.013484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b3637cdc-b7fa-4abd-9e9c-f314045b0355 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.081851 Aug 22 16:13:44.014048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 720/1419] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:43 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:44.890723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:44.892918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:44.899572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:44.900053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:44.900490 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:44.901179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:44.901631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:44.902055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:44.931526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-21603668-f74c-4c2b-9a29-2cd4a0f89acb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Aug 22 16:13:44.932085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 700/1420] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:45.034219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:45.034840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:45.041930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:45.042419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:45.042860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:45.043581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:45.044042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:45.044470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:45.107770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:45.116108 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dfb40cd7-5619-4b29-a2f6-223e506882f9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085166 Aug 22 16:13:45.116679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 721/1421] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:45 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:45.944056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:45.946218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:45.952566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:45.953041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:45.953467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:45.954144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:45.954590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:45.955008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:45.985544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b033df86-8a7b-4a59-87fb-1a0e3f6c9dbd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Aug 22 16:13:45.986087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 701/1422] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:13:46.137241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:46.137860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:46.144388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:46.144872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:46.145314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:46.146014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:46.146471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:46.146898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:46.208267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:46.216053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5882e0aa-4025-4b32-9653-8fbb017cf3cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082649 Aug 22 16:13:46.216612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 722/1423] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:46 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:46.998025 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:47.000239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:47.007052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:47.007568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:47.008008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:47.008700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:47.009148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:47.009570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:47.037905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-00eb768b-2d3a-49d4-a47a-8b28605dd307 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Aug 22 16:13:47.038461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 702/1424] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:47.236973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:47.237575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:47.244700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:47.245172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:47.245602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:47.246286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:47.246733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:47.247151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:47.311044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:47.318925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-719f4b08-5631-49af-a33f-7bd9a1396aa1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085845 Aug 22 16:13:47.319511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 723/1425] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:47 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:48.050024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:48.052234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:48.058614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:48.059089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:48.059562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:48.060250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:48.060700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:48.061122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:48.090269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-39bb1a8e-0761-4689-85a0-eda117b238f5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Aug 22 16:13:48.090818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 703/1426] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:48.340183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:48.340880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:48.347861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:48.348333 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:48.348767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:48.349457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:48.349912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:48.350332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:48.410632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:48.418426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e086d39-9a7b-4f31-8160-2963c58bf38d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082536 Aug 22 16:13:48.418988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 724/1427] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:48 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:49.102812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:49.104984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:49.111361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:49.111840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:49.112268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:49.112941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:49.113384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:49.113802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:49.141856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-11decb50-520b-4c24-872d-7024f29aafda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Aug 22 16:13:49.142403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 704/1428] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:49.439500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:49.440160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:49.446559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:49.447042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:49.447522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:49.448222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:49.448676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:49.449102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:49.512115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:49.519932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-663f123f-24b8-4b2d-b06b-104a8dbbfc3d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084501 Aug 22 16:13:49.520491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 725/1429] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:49 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:50.154466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:50.156638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:50.163013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:50.163538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:50.163977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:50.164664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:50.165122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:50.165602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:50.194388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-077a1941-9e76-4984-9c52-ed937ecfaecd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 Aug 22 16:13:50.194942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 705/1430] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:50.540330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:50.540979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:50.547451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:50.547936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:50.548368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:50.549062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:50.549516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:50.549938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:50.611825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:50.619963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4330dea4-85ca-4ba7-ba34-68b47ffaaed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083583 Aug 22 16:13:50.620525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 726/1431] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:50 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:51.206399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:51.208669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:51.215698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:51.216179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:51.216614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:51.217305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:51.218022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:51.218443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:51.246956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-82e1537b-b81f-4731-baef-2eae8278d9b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Aug 22 16:13:51.247542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 706/1432] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:51.641536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:51.642152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:51.648642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:51.649125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:51.649562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:51.650260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:51.650715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:51.651144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:51.719211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:51.727698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8f8cefe8-a580-4a23-8393-6ccf0cf98d0b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.090451 Aug 22 16:13:51.728267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 727/1433] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:51 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:52.259504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:52.261672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:52.268289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:52.268771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:52.269213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:52.269905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:52.270355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:52.270781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:52.273726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:52.301582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-01dcb404-12fd-4ebd-b4eb-78df70e21d67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Aug 22 16:13:52.302063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 707/1434] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:52.749048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:52.749675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:52.756853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:52.757343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:52.757782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:52.758518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:52.758968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:52.759419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:52.821187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:52.828954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2d388c29-2d84-4cd9-a32b-daef3e69115a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083762 Aug 22 16:13:52.829514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 728/1435] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:52 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:53.313978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:53.316147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:53.323096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:53.323604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:53.324041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:53.324729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:53.325179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:53.325604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:53.355908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-33f1b737-8c05-4bfa-bb73-721e99361e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 Aug 22 16:13:53.356468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 708/1436] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:53.849996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:53.850620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:53.857187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:53.857669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:53.858105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:53.858854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:53.859311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:53.859766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:53.923126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:53.931554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2dd13860-d7ef-4b2f-a83c-feaa6d109883 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085366 Aug 22 16:13:53.932126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 729/1437] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:53 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:54.368728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:54.370887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:54.377299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:54.377768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:54.378195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:54.378904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:54.379368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:54.379794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:54.409795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6460641f-1a0a-4216-9b29-0f01ec20cf38 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Aug 22 16:13:54.410342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 709/1438] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:54.952387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:54.953005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:54.959609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:54.960093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:54.961164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:54.961865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:54.962322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:54.962752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:55.023862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:55.031844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8e792d42-9483-408e-bf21-9286ed7182de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083545 Aug 22 16:13:55.032408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 730/1439] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:54 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:55.423013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:55.425229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:55.432770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:55.433249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:55.433678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:55.434369 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:55.434818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:55.435235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:55.465575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-26803c98-f1d8-436e-8650-1aea42b9fe60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047418 Aug 22 16:13:55.466173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 710/1440] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:56.052531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:56.053156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:56.059794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:56.060279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:56.060723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:56.061417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:56.061872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:56.062298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:56.129322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:56.137814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-133e1906-2b47-427e-9768-e6d866912920 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.089105 Aug 22 16:13:56.138384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 731/1441] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:56 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:56.478242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:56.480540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:56.487031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:56.487556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:56.487998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:56.488694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:56.489208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:56.489587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:56.520190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a0746d0d-f08f-4fb5-b054-6c7f291408f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045914 Aug 22 16:13:56.520742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 711/1442] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:57.159079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:57.159770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:57.166854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:57.167390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:57.167793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:57.168511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:57.168936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:57.169363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:57.232671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:57.240478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f7cb9cab-06d4-4928-bac0-5e7cc82f427f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085296 Aug 22 16:13:57.241043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 732/1443] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:57 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:57.532764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:57.534873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:57.542358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:57.543024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:57.543273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:57.544070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:57.544525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:57.544948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:57.574047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d2989851-7593-480b-8c19-c0541cea1858 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045458 Aug 22 16:13:57.574605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 712/1444] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:58.260922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:58.261573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:58.268217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:58.268706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:58.269147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:58.269853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:58.270309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:58.270741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:58.331641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:58.333805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:58.340842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-82882d5a-cbb3-4c2a-8239-e74478479073 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084429 Aug 22 16:13:58.341418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 733/1445] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:58 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:58.585794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:58.587888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:58.594480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:58.594949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:58.595403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:58.596084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:58.596527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:58.596942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:58.627174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-616a1ced-74e8-440b-93d1-0856649335bd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Aug 22 16:13:58.627762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 713/1446] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:13:59.362230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:59.362788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:59.369999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:59.370619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:59.371219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:59.372157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:59.372628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:59.373060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:59.436353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:13:59.444067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9784ce33-af84-4281-97a7-2d045b8fda8d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085826 Aug 22 16:13:59.444636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 734/1447] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:13:59 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:13:59.639569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:13:59.641750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:13:59.648824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:59.649299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:59.649731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:59.650424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:13:59.650906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:13:59.651299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:13:59.681044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-569c1ff2-4a22-413b-9ff1-2b0da78b566d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Aug 22 16:13:59.681593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 714/1448] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:13:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:00.464915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:00.465532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:00.472230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:00.472708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:00.473142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:00.473827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:00.474281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:00.474703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:00.538640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:00.546454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bc640c97-ce89-4bdd-b83c-f77117321e2e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085392 Aug 22 16:14:00.547025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 735/1449] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:00 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:00.693282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:00.696747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:00.703769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:00.704498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:00.705191 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:00.706449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:00.707185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:00.707673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:00.739315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3cd56cab-963a-4944-bfc3-8c99a2c1e211 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049906 Aug 22 16:14:00.739817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 715/1450] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:01.567269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:01.567926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:01.574877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:01.575423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:01.575870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:01.576568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:01.577028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:01.577458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:01.639761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:01.648633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7f076148-c53d-48fa-a450-2adf973e8e26 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084587 Aug 22 16:14:01.649198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 736/1451] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:01 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:01.752511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:01.754667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:01.761921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:01.762402 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:01.762836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:01.763569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:01.764021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:01.764549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:01.794508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0069587d-a572-4976-aa97-3601c0b977db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 Aug 22 16:14:01.795024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 716/1452] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:02.670175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:02.670776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:02.677242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:02.677727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:02.678166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:02.678863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:02.679872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:02.680304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:02.785952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:02.793950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8e6523a6-f2d2-4e07-a007-eb4715dda450 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.127796 Aug 22 16:14:02.794443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 737/1453] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:02 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:02.806623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:02.808847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:02.815207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:02.815743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:02.816182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:02.816873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:02.817328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:02.817751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:02.846878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-70b6e747-6ff2-4642-8af2-646365592fc9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Aug 22 16:14:02.847512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 717/1454] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:03.814496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:03.815172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:03.822220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:03.822729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:03.823166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:03.823903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:03.824362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:03.824791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:03.859581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:03.861738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:03.868754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:03.869231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:03.869660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:03.870350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:03.870799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:03.871220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:03.886511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:03.894208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-47ed90c0-16ac-41cc-aab2-05d2373eefe0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083615 Aug 22 16:14:03.895008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 738/1455] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:03 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:03.902407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7c997929-5d45-4df2-bb58-fc9d37d89778 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046703 Aug 22 16:14:03.903053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 718/1456] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:14:04.914728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:04.915731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:04.916348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:04.916967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:04.922943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:04.923309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:04.923467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:04.923817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:04.923934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:04.924248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:04.924559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:04.924931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:04.925039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:04.925379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:04.925493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:04.925797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:04.956074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-755a69bc-6ae2-4309-a0c3-86a79d0bbd4d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Aug 22 16:14:04.956643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 739/1457] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:05.035458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:05.043764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ca994fa4-b19f-46fc-8a8b-e42208375975 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.131818 Aug 22 16:14:05.044323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 719/1458] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:04 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:14:05.969786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:05.972065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:05.978450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:05.978931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:05.979390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:05.980076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:05.980527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:05.980949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:06.009335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-abe9eeb3-60b5-4d64-9de4-d65927058878 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 Aug 22 16:14:06.009883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 740/1459] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:06.064706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:06.065324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:06.072355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:06.072834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:06.073270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:06.073972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:06.074429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:06.074861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:06.137247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:06.144953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-37a9f312-27a0-440d-86c7-d42d2a7ed2ad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084126 Aug 22 16:14:06.145515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 720/1460] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:06 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:07.021774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:07.024477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:07.030895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:07.031409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:07.031854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:07.032543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:07.033002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:07.033423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:07.061978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0cde6a3b-3d28-4cca-910d-20995002ae59 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044147 Aug 22 16:14:07.062528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 741/1461] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:07.166951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:07.167599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:07.174007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:07.174487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:07.174927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:07.175654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:07.176111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:07.176537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:07.238960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:07.246989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ecfab045-089f-431f-9687-b0a8e343c653 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084675 Aug 22 16:14:07.247599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 721/1462] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:07 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:08.074224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:08.076433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:08.083086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:08.083612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:08.084058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:08.084755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:08.085870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:08.086147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:08.118325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-348d6c05-580a-44f6-ad4e-e4b6fb1dfb40 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048044 Aug 22 16:14:08.118882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 742/1463] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:08.267507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:08.268128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:08.275116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:08.275625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:08.276070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:08.276765 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:08.277217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:08.277645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:08.339595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:08.347824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-db05fc67-31b0-4fe4-b88a-d9dff4fb516c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084259 Aug 22 16:14:08.348391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 722/1464] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:08 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:09.131931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:09.134611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:09.136497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=56 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:09.141761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:09.142243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:09.142681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:09.143394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:09.143850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:09.144275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:09.174478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-389e0c60-d100-481f-a451-8877e143a519 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047573 Aug 22 16:14:09.175033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 743/1465] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:09.369458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:09.369999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:09.376364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:09.376841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:09.377279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:09.377975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:09.378426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:09.378850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:09.442786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:09.445572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:09.452207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eff0d36b-aa61-41d6-acdb-79a19bcbf35a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087256 Aug 22 16:14:09.452973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 723/1466] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:09 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:10.186710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:10.188827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:10.196242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:10.196724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:10.197162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:10.197883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:10.198325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:10.198748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:10.228240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-27852e54-b87c-46b8-8a91-bb62d3016ca3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045608 Aug 22 16:14:10.228812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 744/1467] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:10.473837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:10.474391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:10.481309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:10.481795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:10.482231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:10.482951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:10.483433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:10.483858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:10.545718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:10.553481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2cb6bd66-16d0-4238-9cfc-32278b3ecceb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084003 Aug 22 16:14:10.554696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 724/1468] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:10 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:11.240440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:11.242667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:11.249154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:11.249634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:11.250071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:11.250763 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:11.251217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:11.251668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:11.281550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-df8ee450-ad3f-4825-9560-3c7c02ae5ee7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Aug 22 16:14:11.282102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 745/1469] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:11.574031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:11.574668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:11.577021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=58 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:11.582274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:11.582759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:11.583198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:11.583922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:11.584380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:11.584919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:11.646862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:11.655086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1ee16971-0b7e-4408-a93f-eca725cb6389 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084943 Aug 22 16:14:11.655676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 725/1470] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:11 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:12.150297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:14:12.150550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:14:12.293876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:12.296173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:12.302467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:12.302951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:12.303425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:12.304635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:12.305090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:12.305511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:12.334188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8978f1a6-5bc0-4afc-b9c0-7067ee3a1cb3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044316 Aug 22 16:14:12.334735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 746/1471] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:12.676460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:12.677014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:12.684092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:12.684569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:12.684996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:12.685678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:12.686123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:12.686541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:12.747184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:12.755312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dc3f74ed-9e0f-4865-8ed2-b39befa608f8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082835 Aug 22 16:14:12.755948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 726/1472] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:12 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:13.145279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:14:13.145521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:14:13.347904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:13.350066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:13.356828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:13.357305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:13.357741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:13.358433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:13.358888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:13.359314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:13.387948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-11334a0f-7b84-4d87-8ae5-d34064d9fce6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Aug 22 16:14:13.388501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 747/1473] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:13.775548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:13.776258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:13.782381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:13.782848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:13.783686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:13.783991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:13.784437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:13.784853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:13.851918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:13.859742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c9e05294-8cf9-4cd9-b1b8-fb2a8f4ca8c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088630 Aug 22 16:14:13.860301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 727/1474] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:13 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:14.401332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:14.403534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:14.409967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:14.410450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:14.410887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:14.411628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:14.412083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:14.412510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:14.442570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2da78f4c-70a6-4142-ab9b-6b03b742b94a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Aug 22 16:14:14.443141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 748/1475] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:14.483420 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:14:14.483685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:14:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:14:14.879641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:14.880295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:14.887111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:14.887701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:14.888138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:14.888835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:14.889292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:14.889721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:14.953361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:14.961439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5a124585-54dd-48ea-939b-18e72a105e7c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085685 Aug 22 16:14:14.962090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 728/1476] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:14 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:15.455441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:15.457687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:15.464128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:15.464604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:15.465067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:15.465755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:15.466207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:15.466628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:15.495433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e5ef7eef-1dd4-4fb4-b450-37e8f9fb3b72 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Aug 22 16:14:15.495975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 749/1477] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:15.982556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:15.983153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:15.989478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:15.989945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:15.990372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:15.991054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:15.991673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:15.992094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:16.053856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:16.061536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6f192069-c27b-42aa-b250-b1527d8fcf39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082770 Aug 22 16:14:16.062093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 729/1478] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:15 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:16.507919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:16.510074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:16.516681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:16.517162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:16.517600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:16.518295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:16.518749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:16.519173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:16.533253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:16.549848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3a8699bc-e521-4be6-8a22-79e9eb114a1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046534 Aug 22 16:14:16.550404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 750/1479] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:17.081721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:17.082313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:17.088490 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:17.088964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:17.089393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:17.090078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:17.090522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:17.090944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:17.151608 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:17.159436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c2bff58d-18a4-44ed-ac5b-074a6da922e2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.081624 Aug 22 16:14:17.159991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 730/1480] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:17 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:17.562238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:17.564451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:17.570942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:17.571460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:17.571902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:17.572588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:17.573041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:17.573465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:17.604172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0c223568-fdf9-4022-969b-b4511768026c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045903 Aug 22 16:14:17.604735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 751/1481] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:18.180093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:18.180703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:18.187146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:18.187666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:18.188101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:18.189082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:18.189829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:18.190630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:18.255849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:18.263813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d6bd421a-1330-43ae-8ce7-266d8a1155ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.088158 Aug 22 16:14:18.264388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 731/1482] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:18 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:18.616459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:18.618622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:18.625517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:18.626094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:18.626578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:18.627279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:18.627751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:18.628172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:18.657993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-24e00c97-1007-4ac4-8721-9fd6f8928dc7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Aug 22 16:14:18.658582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 752/1483] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:19.284497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:19.285083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:19.291473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:19.291955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:19.292382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:19.293063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:19.293510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:19.293927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:19.355224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:19.362908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2a6b1957-c795-4246-9ee8-93644afb2380 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082294 Aug 22 16:14:19.363487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 732/1484] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:19 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:19.670639 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:19.672725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:19.679175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:19.679756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:19.680140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:19.680837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:19.681309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:19.681728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:19.711082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b57f969e-298d-42d1-968f-7452a521a080 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Aug 22 16:14:19.711666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 753/1485] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:20.384598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:20.385149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:20.391844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:20.392333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:20.392767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:20.393494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:20.393946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:20.394374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:20.457654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:20.466145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-97ffdf49-5e4d-4609-b714-c95961b1c826 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086036 Aug 22 16:14:20.466708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 733/1486] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:20 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:20.723303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:20.725431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:20.732418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:20.732846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:20.733536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:20.734264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:20.734890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:20.735347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:20.767012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f850c6a-0ff2-4780-a396-033de044e98f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047776 Aug 22 16:14:20.767766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 754/1487] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:21.486444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:21.486999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:21.493420 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:21.493905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:21.494342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:21.495033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:21.495518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:21.495944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:21.557108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:21.564867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f82ecf20-fb39-48ab-a891-4d50d98f06dd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082454 Aug 22 16:14:21.565433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 734/1488] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:21 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:21.780161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:21.782242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:21.788855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:21.789337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:21.789778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:21.790481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:21.790937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:21.791388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:21.820510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2c899127-3407-447b-9931-f1374439f2ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Aug 22 16:14:21.821064 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 755/1489] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:22.585422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:22.586122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:22.592558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:22.593304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:22.593746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:22.594444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:22.594904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:22.595357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:22.660320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:22.668651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-77bc635a-c1e8-46b1-9805-171bf0bb6991 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087121 Aug 22 16:14:22.669211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 735/1490] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:22 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:22.832526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:22.834679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:22.841637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:22.842125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:22.842569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:22.843554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:22.844010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:22.844438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:22.873302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-94de6a00-1e06-43a2-9629-26a1fb5fdf3e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Aug 22 16:14:22.873858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 756/1491] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:23.689849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:23.690458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:23.697240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:23.697717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:23.698147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:23.698874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:23.699338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:23.699797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:23.762206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:23.770277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7fc5a9e8-1a38-44b4-8aba-6b1b9949949a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084209 Aug 22 16:14:23.770853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 736/1492] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:23 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:23.886116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:23.888301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:23.894885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:23.895400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:23.895843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:23.896547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:23.897002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:23.898129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:23.927084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2f731bdb-96c9-40a1-9659-033f864cd451 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Aug 22 16:14:23.927681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 757/1493] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:24.800447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:24.801026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:24.807870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:24.808359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:24.808803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:24.809528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:24.809982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:24.810403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:24.874013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:24.882430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0d3fc6a3-8f0e-483e-ac9c-32cce89b1fd8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085460 Aug 22 16:14:24.883002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 737/1494] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:24 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:24.938842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:24.941049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:24.948045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:24.948527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:24.948955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:24.949645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:24.950090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:24.950504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:24.982748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-da225f49-fcb7-4b42-9e7c-a4cb3261627c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047854 Aug 22 16:14:24.983320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 758/1495] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:25.903577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:25.904180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:25.910917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:25.911442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:25.911884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:25.912607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:25.913703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:25.914128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:25.983231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:25.991459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e4de2b48-259e-400f-a558-18e6d07d4633 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.091793 Aug 22 16:14:25.992044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 738/1496] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:25 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:25.994966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:25.997186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:26.003901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:26.004392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:26.004832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:26.005533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:26.005986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:26.006419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:26.036041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-379480f5-16df-48eb-9def-de8ba1516ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044973 Aug 22 16:14:26.036611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 759/1497] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:14:27.012894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:27.013495 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:27.020017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:27.020497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:27.020933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:27.021682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:27.022139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:27.022565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:27.048956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:27.051148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:27.058272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:27.058762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:27.059197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:27.059923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:27.060376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:27.060810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:27.088460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:27.091124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b3594667-fd5b-4fba-9877-7b289680e580 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046036 Aug 22 16:14:27.091753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 760/1498] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:14:27.096823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-41c1cc9f-9fb5-4d21-a455-0390eef378d2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087765 Aug 22 16:14:27.097462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 739/1499] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:27 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:28.103906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:28.106083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:28.112671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:28.113081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:28.113522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:28.114228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:28.114684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:28.115111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:28.118355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:28.119006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:28.125403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:28.125886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:28.126323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:28.127021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:28.127506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:28.127931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:28.144569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:28.148194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5043c710-9ef5-4e8e-9abf-3900e0ff83fd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048212 Aug 22 16:14:28.148776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 761/1500] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:28.192551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:28.201016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-393980b2-a5c4-4c4b-94ea-28a5a6b1cb34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087105 Aug 22 16:14:28.201586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 740/1501] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:28 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:14:29.159749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:29.161941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:29.168565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:29.169034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:29.169475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:29.170200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:29.170659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:29.171086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:29.200871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fa35e231-a9d6-4243-b9ec-f1ac37de585f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045116 Aug 22 16:14:29.201437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 762/1502] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:29.221720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:29.222335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:29.228766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:29.229249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:29.229683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:29.230372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:29.230823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:29.231244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:29.296003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:29.303769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6680bbd4-987c-4b00-b631-04204263c8bb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086170 Aug 22 16:14:29.304338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 741/1503] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:29 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:30.213798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:30.215990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:30.222705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:30.223180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:30.223654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:30.224348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:30.224802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:30.225227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:30.254392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a3afd922-22f9-4b35-9a76-35499aec0d1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Aug 22 16:14:30.254956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 763/1504] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:30.323774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:30.324390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:30.330614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:30.331088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:30.331564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:30.332251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:30.332698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:30.333116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:30.393787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:30.402231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-32da39b1-b764-4d5b-8d71-805d6777c8c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082395 Aug 22 16:14:30.402792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 742/1505] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:30 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:31.266830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:31.268910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:31.275584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:31.276085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:31.276511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:31.277189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:31.277632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:31.278047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:31.306600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f98bf6fe-8354-451b-8f71-93817202e687 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Aug 22 16:14:31.307145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 764/1506] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:31.423375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:31.423993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:31.431175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:31.431731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:31.432170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:31.432865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:31.433322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:31.433756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:31.497896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:31.505800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-31b711f4-9386-4d26-9b53-aa899a660945 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086306 Aug 22 16:14:31.506446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 743/1507] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:31 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:32.318420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:32.320555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:32.326979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:32.327496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:32.327934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:32.328630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:32.329087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:32.329513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:32.359662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-869c94f7-dc88-4e5d-aa8e-165a9f2d7de4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045246 Aug 22 16:14:32.360219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 765/1508] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:32.526151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:32.526756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:32.533154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:32.533632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:32.534065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:32.534763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:32.535207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:32.535687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:32.597531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:32.605638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c5ff8f6d-0581-4e76-890e-04f33c97a702 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083435 Aug 22 16:14:32.606213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 744/1509] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:32 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:33.370976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:33.373196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:33.379705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:33.380190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:33.380630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:33.381326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:33.381784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:33.382214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:33.411963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-690530a4-723d-46b0-8674-53e29b3d9ca6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Aug 22 16:14:33.412529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 766/1510] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:33.626542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:33.627253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:33.634334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:33.634818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:33.635254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:33.635982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:33.636443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:33.636864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:33.698928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:33.706798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-01a1279b-a24f-46b6-b8d1-e3c80ffba9d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084228 Aug 22 16:14:33.707384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 745/1511] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:33 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:34.425079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:34.427202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:34.433670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:34.434149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:34.434592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:34.435311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:34.435793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:34.436222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:34.438593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:34.466802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8b0b36e2-a6a6-48f4-9dd2-fa6c78956f83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045801 Aug 22 16:14:34.467373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 767/1512] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:34.728363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:34.728954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:34.735392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:34.735879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:34.736570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:34.737440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:34.737896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:34.738321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:34.799961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:34.808210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f99c6766-b484-4fe7-b623-eda1a9e0b251 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083858 Aug 22 16:14:34.808763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 746/1513] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:34 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:35.480233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:35.482655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:35.489975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:35.490486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:35.491450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:35.492149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:35.492603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:35.493028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:35.523172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ba935465-2ec3-436a-966e-5deff9bfd433 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047535 Aug 22 16:14:35.523754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 768/1514] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:35.829852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:35.830501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:35.837157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:35.837641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:35.838073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:35.838770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:35.839218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:35.839682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:35.904481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:35.912285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-25045da7-6d41-425c-b3ec-b52c7dafe804 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.086398 Aug 22 16:14:35.913359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 747/1515] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:35 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:36.535794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:36.538478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:36.545103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:36.545588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:36.546030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:36.546733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:36.547195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:36.547647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:36.576479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9c8297cf-002b-4686-8f3c-0c94085b20b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 Aug 22 16:14:36.577045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 769/1516] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:36.933201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:36.933822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:36.940317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:36.940789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:36.941230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:36.941924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:36.942390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:36.942808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:37.007259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:37.014987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2dd1a1d4-5faf-483a-ad0e-583d4a64a985 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085590 Aug 22 16:14:37.015576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 748/1517] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:36 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:37.588760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:37.590928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:37.597679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:37.598142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:37.598576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:37.599261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:37.599761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:37.600679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:37.630502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-56c14caf-73c6-431e-adc3-0352b211e293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Aug 22 16:14:37.631129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 770/1518] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:38.036190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:38.036783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:38.043910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:38.044394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:38.044820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:38.045512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:38.045955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:38.046372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:38.108275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:38.115868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7a759883-181d-4a1d-b0dd-6bfb24f2254d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083523 Aug 22 16:14:38.116438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 749/1519] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:38 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:38.642424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:38.644625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:38.651709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:38.652203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:38.652637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:38.653338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:38.653792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:38.654219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:38.684079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e643f457-1723-4b9d-9447-8b5a1dd8b537 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Aug 22 16:14:38.684648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 771/1520] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:39.136662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:39.137284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:39.143747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:39.144230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:39.144668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:39.145367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:39.145908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:39.146248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:39.207371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:39.215695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e2b626f0-14fd-4df1-bf12-7a90afb33910 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082887 Aug 22 16:14:39.216275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 750/1521] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:39 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:39.696483 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:39.698695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:39.701164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=58 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:39.706387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:39.706870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:39.707305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:39.708058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:39.708509 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:39.708939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:39.738489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f28cde4b-92e6-4bbd-9c0d-33907ddb5da1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Aug 22 16:14:39.739043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 772/1522] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:40.237771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:40.238338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:40.245266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:40.245805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:40.246239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:40.246969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:40.247446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:40.247876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:40.312832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:40.321149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9f61ccdb-1a43-4d79-851c-313d8c8772de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087583 Aug 22 16:14:40.321715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 751/1523] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:40 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:40.750793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:40.752948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:40.759267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:40.759771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:40.760204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:40.760889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:40.761336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:40.761754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:40.792617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f9910693-7076-48e6-b3da-e79332841f26 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Aug 22 16:14:40.793093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 773/1524] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:41.341776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:41.342421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:41.349175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:41.349659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:41.350115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:41.350788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:41.351241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:41.351700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:41.412645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:41.420475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-665e6982-07f6-40ae-8001-e0b891bce5de tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.082597 Aug 22 16:14:41.421042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 752/1525] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:41 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:41.805199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:41.807356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:41.814321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:41.814807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:41.815246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:41.815988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:41.816441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:41.816865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:41.847835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d2eacd81-b7dc-46f5-abb3-f95654275a13 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046795 Aug 22 16:14:41.848396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 774/1526] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:42.441404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:42.441962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:42.444886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=56 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:42.450134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:42.450624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:42.451055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:42.451783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:42.452234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:42.452661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:42.515350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:42.523111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a4b383cc-f2de-4b38-9a74-bbd4992e1fbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085778 Aug 22 16:14:42.523701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 753/1527] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:42 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:42.860676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:42.862834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:42.869950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:42.870427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:42.870861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:42.871572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:42.872021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:42.872440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:42.902391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-85adc330-7c3d-4182-92d1-ce4ea8a6cf2e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045620 Aug 22 16:14:42.902941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 775/1528] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:43.545236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:43.545852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:43.552729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:43.553825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:43.554263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:43.554960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:43.555454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:43.555884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:43.620680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:43.628592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8113234a-bd3c-4aca-816d-127b8dca3284 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.087092 Aug 22 16:14:43.629191 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 754/1529] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:43 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:14:43.915286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:43.917511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:43.923536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:43.924022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:43.924496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:43.925143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:43.925593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:43.926017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:43.954292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2b5de4b1-d1ab-4461-9bbf-1a170f5e6948 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Aug 22 16:14:43.954844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 776/1530] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:44.650093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:44.650694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:44.657264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:44.657749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:44.658186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:44.658888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:44.659372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:44.659805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:44.723947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:44.731716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ac23e8cf-f7b7-4f9c-8eb3-84b1f903c71d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.085982 Aug 22 16:14:44.732281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 755/1531] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:44 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:44.966641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:44.969072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:44.976060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:44.976577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:44.976986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:44.977677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:44.978119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:44.978553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:45.009043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-35df25a1-ec31-447a-814a-f9f36c1eb364 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046475 Aug 22 16:14:45.009589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 777/1532] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:45.752463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:45.753085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:45.760241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:45.760722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:45.761155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:45.761842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:45.762288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:45.762706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:45.825436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:45.833273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bfa69f4e-665e-4b26-899e-c26d3d12926f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.084713 Aug 22 16:14:45.833840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 756/1533] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:45 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:14:46.021738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:46.024050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:46.030814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:46.031301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:46.031864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:46.032482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:46.032936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:46.033366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:46.065294 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2a1be122-558c-47ac-9630-7d8c37aa8e99 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047738 Aug 22 16:14:46.065890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 778/1534] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:46.854246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:46.854881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:46.861320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:46.861800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:46.862237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:46.862940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:46.863432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:46.863859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:46.867012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:46.925565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:46.933830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2cf48ea8-f159-4aed-9532-dca3d2b5a4d8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083547 Aug 22 16:14:46.934400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 757/1535] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:46 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:47.078981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:47.081298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:47.087731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:47.088217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:47.088750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:47.089363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:47.089817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:47.090244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:47.121348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-879ed751-342a-48bd-b719-9e2959ff3233 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046344 Aug 22 16:14:47.121859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 779/1536] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:47.955032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:47.955663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 9d36279b-140d-4f9c-bd43-609a981d98d5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:47.962834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:47.963320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:47.963783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:47.964488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:47.964949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:47.965380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:48.026916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:14:48.034774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-333400f2-b169-4639-9a55-643e07a6d616 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5" status: 200 len: 1224 microversion: 2.1 time: 0.083670 Aug 22 16:14:48.035496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 758/1537] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:14:47 2022] GET /compute/v2.1/servers/9d36279b-140d-4f9c-bd43-609a981d98d5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:14:48.134182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:48.136397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:48.143356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:48.143847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:48.144278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:48.144966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:48.145407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:48.146098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:48.175101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-04723ef2-486a-4a72-a4b9-b6268bab7b19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Aug 22 16:14:48.175689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 780/1538] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:49.186999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:49.189216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:49.196315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:49.196806 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:49.197233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:49.197917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:49.198372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:49.198828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:49.227470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fdb84d2e-4a10-4a09-a82b-c01c4fe247ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Aug 22 16:14:49.228028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 759/1539] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:50.239601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:50.242403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:50.248946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:50.249429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:50.249859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:50.250547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:50.250997 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:50.251444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:50.280773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a10b30c3-07db-423c-b134-d898d0635220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Aug 22 16:14:50.281334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 781/1540] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:51.292763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:51.295022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:51.301549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:51.302026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:51.302462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:51.303714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:51.304172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:51.304601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:51.333938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-088f710a-4ad2-4997-b86e-fca64b4ed14b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Aug 22 16:14:51.334501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 760/1541] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:52.346718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:52.348867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:52.355806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:52.356287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:52.356724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:52.357412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:52.357874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:52.358290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:52.387004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-04c6ce95-3d51-4593-83c3-4613d7afc226 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Aug 22 16:14:52.387586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 782/1542] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:53.399989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:53.402165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:53.408591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:53.409077 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:53.409515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:53.410216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:53.410672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:53.411101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:53.440739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0984afc0-daf3-4cdf-b9dc-3f0cfcfdb6aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Aug 22 16:14:53.441294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 761/1543] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:54.453207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:54.455377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:54.461819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:54.462302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:54.462740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:54.463460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:54.463915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:54.464339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:54.490912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:54.496245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-730796c0-1fe3-4343-8f70-bef91d9b962f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047091 Aug 22 16:14:54.496801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 783/1544] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:14:55.140831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:55.141333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:55.151553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:55.152043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:55.152483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:55.153206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:55.153658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:55.154086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:55.509213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:55.511423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:55.518036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:55.518518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:55.518958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:55.519685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:55.520142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:55.520566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:55.552321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-28e2a305-9a4f-4099-9241-ffc1260a8606 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047131 Aug 22 16:14:55.553455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 784/1545] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:14:56.566024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:56.568315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:56.574352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:56.574856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:56.575263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:56.575979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:56.576428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:56.576849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:56.606961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7878d38e-a7a6-40e9-87a6-390941089b41 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045338 Aug 22 16:14:56.607678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 785/1546] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:14:57.620168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:57.622479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:57.628931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:57.629400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:57.629842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:57.630540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:57.631062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:57.631532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:57.660980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aacc6640-99f3-4476-9c59-0fa5a5136624 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Aug 22 16:14:57.661540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 786/1547] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:14:58.673430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:58.675719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:58.682194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:58.682677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:58.683117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:58.683845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:58.684304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:58.684729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:58.715304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cbdae694-dea7-471e-8343-9891106fc468 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045771 Aug 22 16:14:58.715893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 787/1548] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:14:59.731280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:14:59.733858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:14:59.741995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:59.742560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:59.743021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:59.743853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:14:59.744459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:14:59.745001 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:14:59.777266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c025838b-f3fc-4971-9dad-ec8b24e916e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051681 Aug 22 16:14:59.777832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 788/1549] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:14:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:15:00.789843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:00.792044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:00.798714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:00.799197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:00.799669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:00.800372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:00.800855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:00.801276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:00.830832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9fcf53d9-a33b-46d4-a418-564bff208295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Aug 22 16:15:00.831420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 789/1550] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:01.844215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:01.846435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:01.852967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:01.853447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:01.853885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:01.854583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:01.855036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:01.855492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:01.887442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9effa9fd-75c5-41f7-b24f-1a457de578fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Aug 22 16:15:01.888022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 790/1551] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:02.899955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:02.902295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:02.908895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:02.909376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:02.909817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:02.910528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:02.911012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:02.911460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:02.941777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2aad3d87-36b6-4bce-86d5-bafef7f927f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045802 Aug 22 16:15:02.942352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 791/1552] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:03.954413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:03.956618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:03.963680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:03.964162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:03.964597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:03.965284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:03.965729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:03.966152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:03.996221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-20fea7cf-23c1-47ea-86bc-ac55053f84b7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045910 Aug 22 16:15:03.996779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 792/1553] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:05.008695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:05.010859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:05.017516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:05.017998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:05.018437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:05.019153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:05.019673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:05.020253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:05.050679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8760128d-1cfe-4428-916f-4e3e5dacb732 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045988 Aug 22 16:15:05.051242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 793/1554] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:05.148927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=19 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:15:05.173167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=33 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:15:06.062995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:06.065197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:06.071760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:06.072248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:06.072694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:06.073397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:06.073854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:06.074282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:06.104607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b43c1fa1-da08-46d0-90c9-4bade08566c0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045514 Aug 22 16:15:06.105178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 794/1555] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:15:07.117039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:07.119221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:07.125728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:07.126212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:07.126653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:07.127374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:07.127853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:07.128284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:07.157689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ddd378e4-6386-4d6b-ac59-c24ba6ad63f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Aug 22 16:15:07.158263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 795/1556] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:08.170719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:08.172912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:08.179985 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:08.180471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:08.180912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:08.181613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:08.182103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:08.182533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:08.211660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e3ad3fcb-ff28-4380-8c28-9052bd5c29ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Aug 22 16:15:08.212322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 796/1557] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:09.224357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:09.226527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:09.233037 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:09.233522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:09.233963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:09.234658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:09.235116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:09.235569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:09.266438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2da7764e-a766-4d23-95c5-82c2d5dd36a4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 Aug 22 16:15:09.267006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 797/1558] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:10.278915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:10.281078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:10.283412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=52 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:15:10.288691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:10.289177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:10.289620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:10.290325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:10.290784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:10.291213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:10.321691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-05d9fb32-b48b-4924-8af9-04a60bcc08ba tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046802 Aug 22 16:15:10.322256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 798/1559] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:11.334153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:11.336388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:11.343184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:11.344041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:11.344422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:11.345138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:11.345596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:11.346026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:11.377290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-be23bcac-bebf-48a1-9907-c2a90ff8f515 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047134 Aug 22 16:15:11.377874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 799/1560] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:12.388947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:12.391045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:12.397683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:12.398166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:12.398609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:12.399311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:12.399792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:12.400219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:12.414890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:15:12.431404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-46c679cb-0010-488b-b1fa-ebcb923d402f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046476 Aug 22 16:15:12.431968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 800/1561] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:13.444489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:13.446579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:13.452750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:13.453233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:13.453674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:13.454374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:13.454836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:13.455230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:13.488283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a801a7af-b145-4e31-af97-4e1d3d33aa46 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047945 Aug 22 16:15:13.488870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 801/1562] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:15:14.501238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:14.503477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:14.510134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:14.510621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:14.511059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:14.511793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:14.512249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:14.512673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:14.544395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-de39909c-7bde-4d9a-acab-aa45ff9f497b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047044 Aug 22 16:15:14.544976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 802/1563] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:15.557805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:15.560088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:15.566543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:15.567019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:15.567479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:15.568828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:15.569277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:15.569696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:15.599990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-10c88339-9954-4000-9456-f23dc3e89e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Aug 22 16:15:15.600475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 803/1564] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:15:16.612456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:16.614621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:16.621693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:16.622229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:16.622616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:16.623320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:16.623807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:16.624235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:16.654463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-71bc0cf9-3314-4c55-8059-2a0c33a9abb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Aug 22 16:15:16.655048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 804/1565] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:17.666940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:17.669127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:17.675702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:17.676192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:17.676649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:17.677472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:17.677824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:17.678254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:17.706743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ea2fe428-b5fa-4a80-9f64-aa1c7cc1b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Aug 22 16:15:17.707312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 805/1566] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:18.721482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:18.724073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:18.733908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:18.734531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:18.735433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:18.736391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:18.736899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:18.737457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:18.768284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dba69cf9-c625-4f4f-b507-6042c82f4014 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052101 Aug 22 16:15:18.768841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 806/1567] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:15:19.782151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:19.784379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:19.791796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:19.792203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:19.792663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:19.793364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:19.793813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:19.794260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:19.823474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ffaed3b2-f96f-41c5-b524-82ac695f7837 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Aug 22 16:15:19.824037 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 807/1568] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:20.836383 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:20.838542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:20.845336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:20.845815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:20.846250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:20.846952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:20.847437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:20.847861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:20.877410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-99a0cddd-fe66-4d28-a17b-90ce61c49cdd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Aug 22 16:15:20.877963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 808/1569] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:21.890217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:21.892426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:21.899090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:21.899638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:21.900084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:21.900779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:21.901238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:21.901661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:21.931784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ca7e7c37-91b5-4d1d-a9f1-106407c61e52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Aug 22 16:15:21.932356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 809/1570] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:22.944807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:22.946956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:22.953468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:22.953960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:22.954401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:22.955101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:22.955581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:22.956010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:22.986996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-badd2ed9-3e45-4549-8454-67fcbe8d02cb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046758 Aug 22 16:15:22.987596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 810/1571] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:23.999806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:24.001952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:24.008922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:24.009402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:24.009841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:24.010527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:24.010981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:24.011436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:24.040925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1d1fed59-e2f2-4bcf-bba0-7d2840b9a206 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Aug 22 16:15:24.041492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 811/1572] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:25.053361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:25.055564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:25.062065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:25.062554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:25.063003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:25.063802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:25.064263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:25.064688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:25.094556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c8634023-8caa-4a74-bb5b-3b73e6d09cd9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044779 Aug 22 16:15:25.095148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 812/1573] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:26.106268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:26.108470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:26.115798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:26.116286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:26.116725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:26.117426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:26.117882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:26.118312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:26.147412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-741aff29-e544-400e-afc8-513bfe77d995 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Aug 22 16:15:26.147981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 813/1574] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:27.160553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:27.162778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:27.169242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:27.169724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:27.170161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:27.170856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:27.171312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:27.171762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:27.201554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5209441c-7c75-47e9-af99-c1b16bb31a86 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Aug 22 16:15:27.202127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 814/1575] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:28.213802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:28.216004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:28.222779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:28.223264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:28.223733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:28.224436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:28.224890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:28.225309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:28.254998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-99c1aa50-abf8-406a-8267-bb553bb4fc0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Aug 22 16:15:28.256179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 815/1576] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:29.268138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:29.270378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:29.277975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:29.278467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:29.278909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:29.279651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:29.280112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:29.280545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:29.310720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6e2b2aab-db50-4f16-b737-fb04d1973371 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046600 Aug 22 16:15:29.311312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 816/1577] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:30.323379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:30.325560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:30.331995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:30.332480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:30.332915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:30.334122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:30.334578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:30.335005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:30.337425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:15:30.365935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-01510765-b721-4089-a55b-35cf4b25b84e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046450 Aug 22 16:15:30.366485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 817/1578] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:31.378255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:31.380479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:31.387168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:31.387689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:31.388188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:31.388912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:31.389368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:31.389794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:31.419356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b30c5760-1380-4087-a11e-8b4bf7e98aff tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Aug 22 16:15:31.419930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 818/1579] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:32.432560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:32.434634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:32.441200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:32.441686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:32.442121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:32.442839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:32.443349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:32.443774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:32.473440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-07646ca0-0aa7-44de-89d6-3f16cb95276a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Aug 22 16:15:32.474604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 819/1580] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:33.486056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:33.488240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:33.494661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:33.495143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:33.495665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:33.496351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:33.496802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:33.497227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:33.527371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-56a951ef-33ab-499b-a912-545060ac1c8a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Aug 22 16:15:33.527925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 820/1581] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:34.539988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:34.542063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:34.548625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:34.549109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:34.549545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:34.550250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:34.550719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:34.551141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:34.580692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a2684dd3-93ff-4848-be22-e22ba6208612 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 Aug 22 16:15:34.581252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 821/1582] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:35.593781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:35.596263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:35.602811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:35.603296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:35.603768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:35.604478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:35.604934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:35.605362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:35.635469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c4a28473-7170-41aa-880c-8c191a3f0851 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Aug 22 16:15:35.636039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 822/1583] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:36.647057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:36.649268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:36.655924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:36.656409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:36.656847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:36.657547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:36.658005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:36.658431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:36.688988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b873850-b04e-4e5e-b77d-8d56a0ba0a62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045925 Aug 22 16:15:36.689571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 823/1584] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:37.701601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:37.703816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:37.711021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:37.711543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:37.711975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:37.712733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:37.713134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:37.713557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:37.743905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e2e50418-5798-475f-a09d-4d0425f2ec9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046268 Aug 22 16:15:37.744486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 824/1585] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:38.755834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:38.758023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:38.764793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:38.765270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:38.765868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:38.766680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:38.767201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:38.767785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:38.799795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8472e016-f57a-46ce-9042-599665f96c3b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047734 Aug 22 16:15:38.800274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 825/1586] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:39.812083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:39.814222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:39.821160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:39.821632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:39.822069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:39.822754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:39.823200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:39.823658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:39.853878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-761bb12b-b752-468c-b9e2-6c9b2a2d4d23 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045744 Aug 22 16:15:39.854665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 826/1587] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:15:40.866739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:40.869054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:40.870968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=58 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:15:40.876504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:40.876982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:40.877414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:40.878104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:40.878547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:40.878964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:40.909056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e13555f3-bd46-4e7a-9a30-237d5a744229 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046786 Aug 22 16:15:40.909611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 827/1588] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:41.921954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:41.924169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:41.931180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:41.931688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:41.932123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:41.932876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:41.933264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:41.933687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:41.961959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cbf50e2d-bd8e-4971-a4fe-dfbd7862f3c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Aug 22 16:15:41.962518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 828/1589] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:42.893251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:15:42.893942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:15:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 (ip 10.222.0.40) !!! Aug 22 16:15:42.974534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:42.976748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:42.983385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:42.983875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:42.984314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:42.985017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:42.985473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:42.985909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:43.016351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4d93bd22-a4cb-4f3e-9283-a3e16df374bf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Aug 22 16:15:43.016921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 829/1590] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:44.028702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:44.030908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:44.038090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:44.038577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:44.039016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:44.039751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:44.040212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:44.040641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:44.069448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0affe537-4c2e-4b82-ab85-e29221a7d551 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Aug 22 16:15:44.070014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 830/1591] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:45.082054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:45.084856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:45.092781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:45.093279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:45.093722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:45.094805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:45.095157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:45.095689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:45.126927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5a7031c9-024e-4201-aa36-395719517e19 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049252 Aug 22 16:15:45.127588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 831/1592] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:46.139989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:46.142156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:46.148621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:46.149110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:46.149553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:46.150248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:46.150702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:46.151131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:46.181646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d05063d8-878b-4dad-a574-50d122624eb7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Aug 22 16:15:46.182216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 832/1593] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:47.195199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:47.197373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:47.205086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:47.205571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:47.206006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:47.206707 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:47.207163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:47.207616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:47.233512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:15:47.238939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-39792529-c00d-4b5d-9d72-23a4a54257fb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047677 Aug 22 16:15:47.239589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 833/1594] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:48.251733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:48.253857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:48.260512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:48.260996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:48.261422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:48.262101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:48.262543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:48.262958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:48.291888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bb8ed7e6-0496-4128-9c4e-6633c9b7d16b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Aug 22 16:15:48.292437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 834/1595] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:49.303643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:49.305818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:49.312197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:49.312682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:49.313117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:49.313810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:49.314262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:49.314685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:49.343257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b9ae4bc9-74fe-4e22-806b-bb8ece5483aa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 Aug 22 16:15:49.343837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 835/1596] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:50.356428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:50.358479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:50.364911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:50.365976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:50.366407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:50.367088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:50.367563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:50.367980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:50.396212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9b010923-644a-4d68-b10f-b852a4ae8802 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Aug 22 16:15:50.396735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 836/1597] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:51.408384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:51.410570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:51.417628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:51.418112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:51.418547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:51.419240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:51.419720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:51.420146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:51.448174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c07a97f3-8e1d-4ae5-bd46-15c617f4bf22 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Aug 22 16:15:51.448745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 837/1598] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:52.461102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:52.463232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:52.470017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:52.470499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:52.470939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:52.471670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:52.472132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:52.472558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:52.501914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5f5326ae-d2fa-4b1f-8f25-44ea2028bf65 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Aug 22 16:15:52.502758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 838/1599] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:53.514917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:53.517181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:53.524307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:53.524793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:53.525236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:53.525936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:53.526391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:53.526817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:53.557355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a963730a-7691-4c97-96f6-c3258f4b5488 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046441 Aug 22 16:15:53.557939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 839/1600] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:54.569775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:54.571972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:54.578311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:54.578787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:54.579222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:54.579960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:54.580404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:54.580823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:54.611397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7231db9c-dc38-40cc-8c7c-7dd580f526c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045530 Aug 22 16:15:54.611966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 840/1601] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:15:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:15:55.200471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:15:55.200994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:15:55.207120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:55.207626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:55.208066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:15:55.208764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:15:55.209216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:15:55.209640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:16:05.205075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=29 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:16:05.228684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=47 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:16:09.773964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:16:09.774600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 (ip 10.222.0.40) !!! Aug 22 16:16:24.250567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:16:24.251226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:16:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 (ip 10.222.0.40) !!! Aug 22 16:16:46.713005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lazy-loading 'services' on Instance uuid 8bb9f058-ee33-4a96-be12-be17f5ad3204 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:16:46.761239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lazy-loading 'services' on Instance uuid 8bb9f058-ee33-4a96-be12-be17f5ad3204 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:16:55.269240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1e855e59-c8a5-4a98-906f-7b78cb5504f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54" status: 202 len: 0 microversion: 2.1 time: 120.131959 Aug 22 16:16:55.270217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 762/1602] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:14:55 2022] DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 => generated 0 bytes in 120134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:16:55.277742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:16:55.281125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:16:55.289800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:16:55.290508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:16:55.291082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:16:55.292144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:16:55.292853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:16:55.295285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57812905-6b9c-4fcf-9487-ea613d1d3e72) Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Request method failure captured: Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 HTTP/1.1 Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6ngWMqTo7pGm9F8Ga18U_jPJLIHmYasKzUPBwOFyGoPCRez67F9wKt-Ub-i4-0ntM6k_TgbQSNr_iHPjwmRBPMtx9mTX5pmjR15yrTCa7QXDr0HZ16QkZ_SjEx_jEuHPGF21j53j2-6m71KgUyjH2B95RcT6u7O32QM0kJJ5_gglVQ Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: b8cd9041298e400496762808cf2880eb Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:16:55.298901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8cd9041298e400496762808cf2880eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8cd9041298e400496762808cf2880eb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8cd9041298e400496762808cf2880eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8cd9041298e400496762808cf2880eb"}]}] Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: b8cd9041298e400496762808cf2880eb Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesSnapshotTestJSON-51583296-project Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 05a423ada4f24a8aae812a2495771383 Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesSnapshotTestJSON-51583296-project Aug 22 16:16:55.302441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57812905-6b9c-4fcf-9487-ea613d1d3e72) Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '8bb9f058-ee33-4a96-be12-be17f5ad3204', 'id': 'a877d684-0c55-4492-92ca-f5e5248fdd54'} Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:16:55.306366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57812905-6b9c-4fcf-9487-ea613d1d3e72) Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:16:55.309773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57812905-6b9c-4fcf-9487-ea613d1d3e72) Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:16:55.312520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57812905-6b9c-4fcf-9487-ea613d1d3e72) Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:16:55.315958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57812905-6b9c-4fcf-9487-ea613d1d3e72) Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57812905-6b9c-4fcf-9487-ea613d1d3e72) Aug 22 16:16:55.318426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:16:55.320659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57812905-6b9c-4fcf-9487-ea613d1d3e72) {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:16:55.320659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a1a88f4d-2616-4975-842a-855aaf80adf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54" status: 400 len: 269 microversion: 2.1 time: 60.103858 Aug 22 16:16:55.320659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 841/1603] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:15:55 2022] DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 => generated 269 bytes in 60105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 16:16:55.321131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:16:55.321288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:16:55.321288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:16:55.329512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:16:55.329512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:16:55.330065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:16:55.330585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:16:55.331007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:16:55.331455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:16:55.355893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-417e5964-6b2f-4956-a21d-31835fb97b1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084159 Aug 22 16:16:55.356464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 763/1604] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Aug 22 16:16:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:16:56.369622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:16:56.372058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:16:56.379280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:16:56.379789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:16:56.380220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:16:56.380913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:16:56.381362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:16:56.381783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:16:56.496797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9cf18801-e91f-4d04-a187-83e74e54495b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/action" status: 200 len: 82264 microversion: 2.1 time: 0.130945 Aug 22 16:16:56.498997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 764/1605] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:16:56 2022] POST /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/action => generated 82264 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 16:16:56.512836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:16:56.513443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:16:56.521169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:16:56.521635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:16:56.522062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:16:56.522748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:16:56.523190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:16:56.523636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:17:05.329132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:17:05.354583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=8 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:17:06.518289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:17:06.543752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:17:32.158075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:17:32.158794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:17:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 (ip 10.222.0.40) !!! Aug 22 16:17:33.154312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:17:33.154584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 (ip 10.222.0.40) !!! Aug 22 16:17:34.493070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:17:34.493657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:17:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae (ip 10.222.0.40) !!! Aug 22 16:18:46.888686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lazy-loading 'services' on Instance uuid 8bb9f058-ee33-4a96-be12-be17f5ad3204 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:18:47.054493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lazy-loading 'services' on Instance uuid 11a2bdd7-2790-42d9-914e-4dab6caaec39 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:18:55.473017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfd51dfe-501d-40ae-9e66-69d3e01596f8) Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Request method failure captured: Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 HTTP/1.1 Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6ngWMqTo7pGm9F8Ga18U_jPJLIHmYasKzUPBwOFyGoPCRez67F9wKt-Ub-i4-0ntM6k_TgbQSNr_iHPjwmRBPMtx9mTX5pmjR15yrTCa7QXDr0HZ16QkZ_SjEx_jEuHPGF21j53j2-6m71KgUyjH2B95RcT6u7O32QM0kJJ5_gglVQ Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: b8cd9041298e400496762808cf2880eb Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:18:55.475753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8cd9041298e400496762808cf2880eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8cd9041298e400496762808cf2880eb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8cd9041298e400496762808cf2880eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8cd9041298e400496762808cf2880eb"}]}] Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: b8cd9041298e400496762808cf2880eb Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesSnapshotTestJSON-51583296-project Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 05a423ada4f24a8aae812a2495771383 Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesSnapshotTestJSON-51583296-project Aug 22 16:18:55.477403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfd51dfe-501d-40ae-9e66-69d3e01596f8) Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '8bb9f058-ee33-4a96-be12-be17f5ad3204', 'id': 'a877d684-0c55-4492-92ca-f5e5248fdd54'} Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.479186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfd51dfe-501d-40ae-9e66-69d3e01596f8) Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.481692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfd51dfe-501d-40ae-9e66-69d3e01596f8) Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.483850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfd51dfe-501d-40ae-9e66-69d3e01596f8) Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.485074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfd51dfe-501d-40ae-9e66-69d3e01596f8) Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfd51dfe-501d-40ae-9e66-69d3e01596f8) Aug 22 16:18:55.486555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.488142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfd51dfe-501d-40ae-9e66-69d3e01596f8) {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:18:55.488142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e2e87ed-ac8b-4097-9fd9-99af3dc8bdf1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54" status: 400 len: 269 microversion: 2.1 time: 120.175527 Aug 22 16:18:55.488142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 842/1606] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:16:55 2022] DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 => generated 269 bytes in 120176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:18:55.488142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:18:55.488542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:18:55.490672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:18:55.491164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:18:55.491635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:18:55.492340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:18:55.492792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:18:55.493218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:18:55.515866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06b6a887-c3c1-4974-b871-be707e5df50b) Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Request method failure captured: Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae HTTP/1.1 Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6nmH3GLc0yS-e2G-mNnGE1yl6IYL7yLN7jLhLfaN4eHMeHv24E3M_rFf9K1RP6UikMtzSn1dyRUf5BUd9reAkbtxNP0r7LfP1jh5xZJMhskJpHJNP_oesXEL6cPvzvI6ofgnVk1t_77l4wu-HE0QQIejB83FLv9E3_unyC2Sfrb9lo Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: d3f48363627d49948f567e5dd81e873a Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestMinimumBasicScenario-70130478 Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:18:55.520220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d3f48363627d49948f567e5dd81e873a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d3f48363627d49948f567e5dd81e873a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d3f48363627d49948f567e5dd81e873a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d3f48363627d49948f567e5dd81e873a"}]}] Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestMinimumBasicScenario-70130478 Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: d3f48363627d49948f567e5dd81e873a Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestMinimumBasicScenario-70130478 Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-TestMinimumBasicScenario-70130478-project Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: a379a0d6d7ef4453a10b4727cf19eb00 Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestMinimumBasicScenario-70130478-project Aug 22 16:18:55.522604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06b6a887-c3c1-4974-b871-be707e5df50b) Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'server_id': '11a2bdd7-2790-42d9-914e-4dab6caaec39', 'id': '20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae'} Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.523523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06b6a887-c3c1-4974-b871-be707e5df50b) Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.527245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06b6a887-c3c1-4974-b871-be707e5df50b) Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.528904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06b6a887-c3c1-4974-b871-be707e5df50b) Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.530998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06b6a887-c3c1-4974-b871-be707e5df50b) Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06b6a887-c3c1-4974-b871-be707e5df50b) Aug 22 16:18:55.532834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.535228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06b6a887-c3c1-4974-b871-be707e5df50b) {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:18:55.536158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d594064f-de80-4f92-8aba-8168333fa9cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae" status: 400 len: 269 microversion: 2.1 time: 119.028073 Aug 22 16:18:55.538202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 765/1607] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:16:56 2022] DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae => generated 269 bytes in 119030 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:18:55.544570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:18:55.545072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:18:55.551475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:18:55.551968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:18:55.552406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:18:55.553712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:18:55.554168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:18:55.554596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:18:55.618265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lazy-loading 'services' on Instance uuid 8bb9f058-ee33-4a96-be12-be17f5ad3204 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:18:55.658167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lazy-loading 'services' on Instance uuid 11a2bdd7-2790-42d9-914e-4dab6caaec39 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:18:55.686251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93d7aada-31c8-4ad0-8e7d-d7a77dbf1bb9) Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Request method failure captured: Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 HTTP/1.1 Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6ngWMqTo7pGm9F8Ga18U_jPJLIHmYasKzUPBwOFyGoPCRez67F9wKt-Ub-i4-0ntM6k_TgbQSNr_iHPjwmRBPMtx9mTX5pmjR15yrTCa7QXDr0HZ16QkZ_SjEx_jEuHPGF21j53j2-6m71KgUyjH2B95RcT6u7O32QM0kJJ5_gglVQ Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: b8cd9041298e400496762808cf2880eb Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:18:55.688493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8cd9041298e400496762808cf2880eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8cd9041298e400496762808cf2880eb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8cd9041298e400496762808cf2880eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8cd9041298e400496762808cf2880eb"}]}] Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: b8cd9041298e400496762808cf2880eb Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesSnapshotTestJSON-51583296-project Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 05a423ada4f24a8aae812a2495771383 Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesSnapshotTestJSON-51583296-project Aug 22 16:18:55.690181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93d7aada-31c8-4ad0-8e7d-d7a77dbf1bb9) Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '8bb9f058-ee33-4a96-be12-be17f5ad3204', 'id': 'a877d684-0c55-4492-92ca-f5e5248fdd54'} Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.691282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93d7aada-31c8-4ad0-8e7d-d7a77dbf1bb9) Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.692621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93d7aada-31c8-4ad0-8e7d-d7a77dbf1bb9) Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.694138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93d7aada-31c8-4ad0-8e7d-d7a77dbf1bb9) Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.695489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93d7aada-31c8-4ad0-8e7d-d7a77dbf1bb9) Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93d7aada-31c8-4ad0-8e7d-d7a77dbf1bb9) Aug 22 16:18:55.696886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.698257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93d7aada-31c8-4ad0-8e7d-d7a77dbf1bb9) {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:18:55.698257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af01ed8f-c87e-47c8-beaf-b5bcfd354ea5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54" status: 400 len: 269 microversion: 2.1 time: 0.211257 Aug 22 16:18:55.698257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 843/1608] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:18:55 2022] DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 => generated 269 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:18:55.698257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:18:55.698638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:18:55.702050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:18:55.702529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:18:55.702958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:18:55.703710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:18:55.704158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:18:55.704580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:18:55.721998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3934c7d-625e-42ba-88c8-7e3e08e4f2ae) Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Request method failure captured: Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae HTTP/1.1 Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6nmH3GLc0yS-e2G-mNnGE1yl6IYL7yLN7jLhLfaN4eHMeHv24E3M_rFf9K1RP6UikMtzSn1dyRUf5BUd9reAkbtxNP0r7LfP1jh5xZJMhskJpHJNP_oesXEL6cPvzvI6ofgnVk1t_77l4wu-HE0QQIejB83FLv9E3_unyC2Sfrb9lo Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: d3f48363627d49948f567e5dd81e873a Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestMinimumBasicScenario-70130478 Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:18:55.724295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d3f48363627d49948f567e5dd81e873a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d3f48363627d49948f567e5dd81e873a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d3f48363627d49948f567e5dd81e873a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d3f48363627d49948f567e5dd81e873a"}]}] Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestMinimumBasicScenario-70130478 Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: d3f48363627d49948f567e5dd81e873a Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestMinimumBasicScenario-70130478 Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-TestMinimumBasicScenario-70130478-project Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: a379a0d6d7ef4453a10b4727cf19eb00 Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestMinimumBasicScenario-70130478-project Aug 22 16:18:55.726888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3934c7d-625e-42ba-88c8-7e3e08e4f2ae) Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'server_id': '11a2bdd7-2790-42d9-914e-4dab6caaec39', 'id': '20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae'} Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.727747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3934c7d-625e-42ba-88c8-7e3e08e4f2ae) Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.729111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3934c7d-625e-42ba-88c8-7e3e08e4f2ae) Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.730586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3934c7d-625e-42ba-88c8-7e3e08e4f2ae) Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.731795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3934c7d-625e-42ba-88c8-7e3e08e4f2ae) Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3934c7d-625e-42ba-88c8-7e3e08e4f2ae) Aug 22 16:18:55.733232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.734649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3934c7d-625e-42ba-88c8-7e3e08e4f2ae) {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:18:55.734649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e03f754c-f30a-47a3-9758-26b16c923747 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae" status: 400 len: 269 microversion: 2.1 time: 0.189099 Aug 22 16:18:55.734649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 766/1609] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:18:55 2022] DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39/os-volume_attachments/20b634f4-d3b7-4f5d-a7c2-76f3a8e35cae => generated 269 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:18:55.833086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lazy-loading 'services' on Instance uuid 8bb9f058-ee33-4a96-be12-be17f5ad3204 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:18:55.901645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1be9c934-2b84-4c5c-bc37-6e93db1e1a61) Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Request method failure captured: Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 HTTP/1.1 Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6ngWMqTo7pGm9F8Ga18U_jPJLIHmYasKzUPBwOFyGoPCRez67F9wKt-Ub-i4-0ntM6k_TgbQSNr_iHPjwmRBPMtx9mTX5pmjR15yrTCa7QXDr0HZ16QkZ_SjEx_jEuHPGF21j53j2-6m71KgUyjH2B95RcT6u7O32QM0kJJ5_gglVQ Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: b8cd9041298e400496762808cf2880eb Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:18:55.903830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8cd9041298e400496762808cf2880eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8cd9041298e400496762808cf2880eb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8cd9041298e400496762808cf2880eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8cd9041298e400496762808cf2880eb"}]}] Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: b8cd9041298e400496762808cf2880eb Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-51583296 Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesSnapshotTestJSON-51583296-project Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: 05a423ada4f24a8aae812a2495771383 Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesSnapshotTestJSON-51583296-project Aug 22 16:18:55.905537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1be9c934-2b84-4c5c-bc37-6e93db1e1a61) Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '8bb9f058-ee33-4a96-be12-be17f5ad3204', 'id': 'a877d684-0c55-4492-92ca-f5e5248fdd54'} Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.906356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1be9c934-2b84-4c5c-bc37-6e93db1e1a61) Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 16:18:55.907801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1be9c934-2b84-4c5c-bc37-6e93db1e1a61) Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.909319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1be9c934-2b84-4c5c-bc37-6e93db1e1a61) Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.911126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1be9c934-2b84-4c5c-bc37-6e93db1e1a61) Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1be9c934-2b84-4c5c-bc37-6e93db1e1a61) Aug 22 16:18:55.913228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:18:55.915288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1be9c934-2b84-4c5c-bc37-6e93db1e1a61) {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:18:55.915288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b45ac4ce-919c-4d13-93b1-dd6eee6eb763 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54" status: 400 len: 269 microversion: 2.1 time: 0.213788 Aug 22 16:18:55.915288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 844/1610] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Aug 22 16:18:55 2022] DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204/os-volume_attachments/a877d684-0c55-4492-92ca-f5e5248fdd54 => generated 269 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 16:19:02.902736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:19:02.903364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:19:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:19:29.782779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:19:29.783598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:19:44.259875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:19:44.260478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:19:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:20:52.169462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:20:52.170044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:20:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:20:53.162867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:20:53.163146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:20:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:20:54.502482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:20:54.503099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:20:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:22:22.911892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:22:22.912623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:22:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:22:49.793652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:22:49.794417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:22:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:23:04.268068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:23:04.268759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:23:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:24:12.178949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:24:12.179979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:24:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:24:13.170869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:24:13.171145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:24:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:24:14.514818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:24:14.515742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:24:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:24:55.020239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5bc4e9-e1a3-4993-9cef-bfb47aa95408] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 16:24:55.020906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:24:55.021440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=12 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:24:55.025568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:55.026057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:55.032744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:55.033215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:55.033644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:55.034328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:55.034771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:55.035184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:55.060085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:24:55.139367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cb6cde0d-3b07-4cd2-a909-29efa2f542ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 204 len: 0 microversion: 2.1 time: 0.120585 Aug 22 16:24:55.140058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 767/1611] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:24:55 2022] DELETE /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:24:55.146277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR oslo.messaging._drivers.impl_rabbit [-] [677f6770-985d-4059-b9ba-c69246eaeb8b] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 16:24:55.146910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:24:55.147715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=20 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:24:55.152469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:55.153122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:55.159954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:55.160442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:55.160886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:55.161591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:55.162045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:55.162474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:55.430912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:24:55.439143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-400b62ab-98dc-46fd-8b02-ba841187ff16 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.294746 Aug 22 16:24:55.439735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 845/1612] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:24:55 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:24:55.665405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:55.666086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:55.672109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:55.672586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:55.673015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:55.674968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:55.674968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:55.674968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:55.699369 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:24:55.775067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b4e7586e-a2f4-43cd-950e-a394e343177e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 204 len: 0 microversion: 2.1 time: 0.113765 Aug 22 16:24:55.775688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 768/1613] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:24:55 2022] DELETE /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:24:55.784469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:55.785092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:55.791194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:55.791660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:55.792089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:55.792791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:55.793242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:55.793664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:55.927097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:24:55.936350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aa601223-61f7-4f5b-b9ae-cecca0c822f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1601 microversion: 2.1 time: 0.156270 Aug 22 16:24:55.936947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 846/1614] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:24:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:24:56.460595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:56.461325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:56.468138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:56.468630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:56.469059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:56.469762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:56.470215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:56.470639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:56.494949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5bc4e9-e1a3-4993-9cef-bfb47aa95408] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33472. Aug 22 16:24:56.670611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:24:56.679742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8c99cbc1-8b09-4a5f-9ec7-7effdf5f3bd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.223315 Aug 22 16:24:56.680325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 769/1615] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:24:56 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:24:56.958124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:56.958721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:56.966111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:56.966594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:56.967573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:56.967748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:56.968197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:56.968613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:56.976077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] [677f6770-985d-4059-b9ba-c69246eaeb8b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33480. Aug 22 16:24:57.111510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:24:57.119856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-334adcc2-3e4f-478b-adde-07085eef7b35 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1601 microversion: 2.1 time: 0.165560 Aug 22 16:24:57.120510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 847/1616] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:24:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:24:57.429333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-d7a2aa61-9d68-493c-b1a7-f0f96ce927fb req-9d8838bb-44f1-4161-b946-0320ed822d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a2bdd7-2790-42d9-914e-4dab6caaec39", "name": "network-vif-deleted", "tag": "2af7b377-5d28-4879-ae25-955d593fbddf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:24:57.440258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d7a2aa61-9d68-493c-b1a7-f0f96ce927fb req-9d8838bb-44f1-4161-b946-0320ed822d94 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:57.440258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d7a2aa61-9d68-493c-b1a7-f0f96ce927fb req-9d8838bb-44f1-4161-b946-0320ed822d94 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:57.440518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d7a2aa61-9d68-493c-b1a7-f0f96ce927fb req-9d8838bb-44f1-4161-b946-0320ed822d94 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:57.451445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-d7a2aa61-9d68-493c-b1a7-f0f96ce927fb req-9d8838bb-44f1-4161-b946-0320ed822d94 service nova] Creating event network-vif-deleted:2af7b377-5d28-4879-ae25-955d593fbddf for instance 11a2bdd7-2790-42d9-914e-4dab6caaec39 on hv-cinder-85400 Aug 22 16:24:57.457043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-d7a2aa61-9d68-493c-b1a7-f0f96ce927fb req-9d8838bb-44f1-4161-b946-0320ed822d94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094953 Aug 22 16:24:57.457636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 770/1617] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:24:57.701573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:57.702356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:57.710584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:57.711075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:57.711553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:57.712452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:57.712920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:57.713498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:57.858403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:24:57.868170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a9ef3190-3145-4c6c-b37d-b19775a01e9c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170568 Aug 22 16:24:57.868752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 848/1618] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:24:57 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:24:58.142896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:58.143619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:58.150345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:58.150826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:58.151263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:58.151981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:58.152436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:58.152861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:58.215974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:24:58.225087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-93a85740-6fd5-4840-b54d-4fcf838521be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086547 Aug 22 16:24:58.225650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 771/1619] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:24:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:24:58.889977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:58.890604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:58.897043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:58.897517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:58.897941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:58.898643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:58.899076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:58.899526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:59.034998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:24:59.043679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8ba908f6-0c53-47bc-bd97-dbbaf552c559 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.157526 Aug 22 16:24:59.044242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 849/1620] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:24:58 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:24:59.247123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:24:59.247719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:24:59.254144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:59.254616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:59.255043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:59.255751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:24:59.256199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:24:59.256616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:24:59.324010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:24:59.332789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9030a7f0-eaf7-44c5-9aaf-dfe00f507e9b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089595 Aug 22 16:24:59.333346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 772/1621] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:24:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:00.066057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:00.066663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:00.073094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:00.073576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:00.074141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:00.074868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:00.075351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:00.075799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:00.204773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:00.212979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-189d1a2a-166c-4e7c-939c-033d24198f93 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151452 Aug 22 16:25:00.213541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 850/1622] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:00 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:00.354124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:00.354715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:00.361566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:00.362047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:00.362485 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:00.363177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:00.363675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:00.364101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:00.427093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:00.435245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d253a654-2521-4b83-9d16-369a468d2354 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085046 Aug 22 16:25:00.435828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 773/1623] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:01.234327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:01.235571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:01.241952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:01.242432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:01.242869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:01.243580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:01.244039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:01.244459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:01.373722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:01.381927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ccd555d5-5bcf-4a0b-afa0-ba79debaf2c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151507 Aug 22 16:25:01.382485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 851/1624] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:01 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:01.456635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:01.457260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:01.465383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:01.465867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:01.466302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:01.466992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:01.468275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:01.468706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:01.530691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:01.539523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8d02df2-3d12-4ffb-aacf-9b383300c0fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086926 Aug 22 16:25:01.540403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 774/1625] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:02.402880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:02.403536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:02.409996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:02.410472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:02.410901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:02.411616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:02.412063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:02.412513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:02.541119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:02.549903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d3fa2ed5-eb83-44c5-a877-184f63451960 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150857 Aug 22 16:25:02.550475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 852/1626] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:02 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:02.559789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:02.560437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:02.567496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:02.567983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:02.568417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:02.569110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:02.569564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:02.569990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:02.636089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:02.644354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4c86d3dc-f2ef-43af-b929-8ca5827f5d8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088362 Aug 22 16:25:02.644924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 775/1627] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:03.571713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:03.572330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:03.579561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:03.580063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:03.580501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:03.581205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:03.581661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:03.582090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:03.665028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:03.665641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:03.672218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:03.672707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:03.673141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:03.673841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:03.674293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:03.674715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:03.720796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:03.729328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2fda9c0d-a694-4e46-8726-04b99ff82f42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161412 Aug 22 16:25:03.729903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 853/1628] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:03 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:03.740371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:03.748673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f7b7d78b-2024-4898-bcb9-b37e4900f95c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087509 Aug 22 16:25:03.749256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 776/1629] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:04.750789 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:04.751370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:04.757760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:04.758245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:04.758688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:04.759408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:04.759870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:04.760296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:04.769618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:04.770233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:04.776881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:04.777363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:04.777796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:04.778492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:04.778948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:04.779395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:04.862478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:04.870686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3976e476-4844-438f-9e0c-56e603d54e48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.105363 Aug 22 16:25:04.871252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 777/1630] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:04.919877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:04.928098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-669d77c4-c0e7-477d-9939-26cf04f223f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.181363 Aug 22 16:25:04.928660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 854/1631] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:04 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:05.891990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:05.892610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:05.899350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:05.899838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:05.900275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:05.900964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:05.901417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:05.901842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:05.949393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:05.949992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:05.957412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:05.957903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:05.958340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:05.959040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:05.959558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:05.960346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:05.962428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:05.970874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c89a1357-c69f-4f88-ba2d-c5e9647b1de7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083328 Aug 22 16:25:05.971464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 778/1632] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:06.092801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:06.102838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0d385c8b-8005-48f6-a88d-1d90ceeec7f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.157270 Aug 22 16:25:06.103427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 855/1633] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:05 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:06.991951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:06.992554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:06.999141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:06.999880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:07.000323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:07.001023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:07.001474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:07.001901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:07.062034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:07.070173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f4602ad6-b122-48ca-8a9d-48a65117eff9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082188 Aug 22 16:25:07.070737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 779/1634] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:07.124145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:07.124758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:07.131189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:07.131703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:07.132137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:07.132824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:07.133278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:07.133700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:07.262607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:07.271519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5f6a126d-aca6-428c-83f5-216cbcfd5809 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151161 Aug 22 16:25:07.272082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 856/1635] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:07 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:08.091626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:08.092248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:08.098855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:08.099354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:08.099813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:08.100508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:08.100966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:08.101396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:08.161891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:08.165418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:08.170853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a78a7060-4266-4daa-8f4d-e04e20f08124 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083144 Aug 22 16:25:08.171433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 780/1636] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:08.292300 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:08.292951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:08.299393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:08.299877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:08.300314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:08.301004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:08.301462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:08.301886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:08.432901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:08.441692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-43003009-1250-46da-bd2f-7574d3680772 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153211 Aug 22 16:25:08.442263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 857/1637] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:08 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:09.191464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:09.192089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:09.199443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:09.199922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:09.200352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:09.201030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:09.201476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:09.201890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:09.263263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:09.271505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2ae37d17-d1e6-4b65-a82d-874f2d917fc3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084709 Aug 22 16:25:09.272713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 781/1638] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:09.462829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:09.463456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:09.470104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:09.470589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:09.471026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:09.471754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:09.472209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:09.472631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:09.611278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:09.619710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c9e4954f-c242-4129-941d-9166df8bd7b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.160813 Aug 22 16:25:09.620272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 858/1639] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:09 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:10.291903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:10.292461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:10.299471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:10.299947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:10.300376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:10.301058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:10.301512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:10.301932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:10.362215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:10.370359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c8da1e6c-2ae4-47bb-af54-43360ea1ad05 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082376 Aug 22 16:25:10.370912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 782/1640] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:10.641395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:10.642008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:10.648606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:10.649086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:10.649523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:10.650213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:10.650664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:10.651092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:10.777928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:10.786051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2afa815e-7704-4834-8abb-c18a733f5569 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.148575 Aug 22 16:25:10.786625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 859/1641] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:10 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:11.392200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:11.392766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:11.399125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:11.399634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:11.400075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:11.400768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:11.401224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:11.401649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:11.461686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:11.470466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b3325c28-bf2c-4a11-a59d-6e088e8dfed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082834 Aug 22 16:25:11.471023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 783/1642] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:11.807905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:11.808439 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:11.815403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:11.815887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:11.816326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:11.817021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:11.817477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:11.817903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:11.947531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:11.956322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0535f405-13ac-4c5d-a46b-fa221c6ffc9f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152381 Aug 22 16:25:11.956887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 860/1643] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:11 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:12.491699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:12.492317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:12.498630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:12.499119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:12.499607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:12.500629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:12.502044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:12.502476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:12.563678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:12.573354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4eabe25b-d185-4f11-8b84-5079ad3dfaa1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085409 Aug 22 16:25:12.573930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 784/1644] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:12.977716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:12.978324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:12.984767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:12.985241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:12.985673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:12.986355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:12.986805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:12.987220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:13.007244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:13.127183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:13.135500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d81ea77e-017f-483b-8738-ac4e06f18b90 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161541 Aug 22 16:25:13.136224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 861/1645] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:12 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:13.595262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:13.595893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:13.603142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:13.603682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:13.604125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:13.604885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:13.605779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:13.605953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:13.680218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:13.689573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3fcc6189-de18-41c9-be64-48094c2b1395 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.099150 Aug 22 16:25:13.690235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 785/1646] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:14.168924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:14.169486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:14.175947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:14.176429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:14.176868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:14.177574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:14.178015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:14.178440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:14.304516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:14.313337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c4eff31d-0c38-4bb0-9b94-716dd7260a3b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.147823 Aug 22 16:25:14.313906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 862/1647] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:14 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:14.710613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:14.711153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:14.717518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:14.718023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:14.718455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:14.719677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:14.720126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:14.720546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:14.783887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:14.792393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e04ac6c4-144c-4a01-8be1-d389ca3ca46e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085719 Aug 22 16:25:14.792968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 786/1648] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:15.334684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:15.335246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:15.341861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:15.342343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:15.342775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:15.343507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:15.344563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:15.344987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:15.475470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:15.483663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c9a6d9ac-ec93-4b0e-bc21-e78a55dabd97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152929 Aug 22 16:25:15.484228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 863/1649] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:15 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:15.822119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:15.822728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:15.829930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:15.830407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:15.830838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:15.831555 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:15.832032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:15.832431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:15.893290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:15.901522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4326e227-c1f1-4f9f-a988-5253b47c5f7b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083264 Aug 22 16:25:15.902091 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 787/1650] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:16.504496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:16.505116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:16.511743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:16.512226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:16.512671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:16.513371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:16.513829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:16.514255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:16.646143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:16.654331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4a417e12-f3e1-4622-833b-1ee4cf644729 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153752 Aug 22 16:25:16.654887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 864/1651] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:16 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:16.922142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:16.922735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:16.929224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:16.929704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:16.930135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:16.930818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:16.931267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:16.931711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:16.993064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:17.001808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-770c3586-7913-4b8c-bb4f-b4346c00cd68 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083601 Aug 22 16:25:17.002365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 788/1652] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:17.676798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:17.677445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:17.683876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:17.684357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:17.684791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:17.685479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:17.685934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:17.686359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:17.817338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:17.825494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fb4c2368-ee06-469b-9934-a7a02c3303ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152665 Aug 22 16:25:17.826054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 865/1653] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:17 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:18.022202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:18.022820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:18.029358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:18.029838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:18.030275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:18.030965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:18.031952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:18.032379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:18.091975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:18.100997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e5577f6f-61e6-4b93-a66d-90707e3f1f15 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082752 Aug 22 16:25:18.101562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 789/1654] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:18.846580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:18.847207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:18.854305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:18.854791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:18.855228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:18.855974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:18.856435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:18.856863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:18.986119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:18.994259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eb1e0f99-19c5-4dc9-b27e-d4d043f7e295 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152246 Aug 22 16:25:18.994823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 866/1655] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:18 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:19.123437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:19.123972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:19.130371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:19.130853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:19.131289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:19.132016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:19.132465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:19.132886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:19.195472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:19.204412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-50fb2fd3-0749-4d62-86e6-509b0cd5db55 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084893 Aug 22 16:25:19.204981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 790/1656] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:20.015238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:20.015983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:20.022330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:20.022845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:20.023280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:20.024002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:20.024454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:20.024877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:20.156980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:20.165209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-89b2472b-8efd-4c19-84ce-fd90438bb4d8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153823 Aug 22 16:25:20.165769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 867/1657] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:20 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:20.225389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:20.225994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:20.232643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:20.233124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:20.233547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:20.234820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:20.235269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:20.235711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:20.295671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:20.304375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-28e71ec6-cb86-4c09-b2c6-ed278509cd62 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083071 Aug 22 16:25:20.305247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 791/1658] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:21.186545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:21.187147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:21.194158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:21.194642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:21.195077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:21.195866 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:21.196321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:21.196745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:21.325220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:21.326184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:21.326884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:21.333380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:21.333620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a0cf16d4-b9ee-4ea3-b3b8-2d271093a2d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150806 Aug 22 16:25:21.333864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:21.334133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 868/1659] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:21 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:21.334307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:21.335150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:21.335662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:21.336089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:21.397072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:21.405208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cfe775b3-5f0d-4178-a78c-5bca1a3f18e6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083121 Aug 22 16:25:21.405771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 792/1660] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:22.354979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:22.355646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:22.362927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:22.363457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:22.363902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:22.364603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:22.365055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:22.365480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:22.426560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:22.427691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:22.433894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:22.434365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:22.434795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:22.435696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:22.436144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:22.436562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:22.508581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:22.517395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9cc1ed2a-6514-4939-9077-cd1847b8eb3c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.095299 Aug 22 16:25:22.518006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 793/1661] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:22.524813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:22.533873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-695ca33f-52df-4586-953b-330a56e8a6f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.182827 Aug 22 16:25:22.534506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 869/1662] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:22 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:23.538042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:23.538645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:23.545324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:23.545866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:23.546309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:23.547000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:23.547489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:23.547929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:23.556566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:23.557176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:23.564079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:23.564561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:23.565147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:23.565924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:23.566449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:23.566895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:23.620136 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:23.628356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-33885eb0-89b9-4cad-bcbb-ce942dbaa450 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.094133 Aug 22 16:25:23.628928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 794/1663] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:23.713582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:23.722290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-10824bca-8b20-4839-9923-b3b28a56434f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.169465 Aug 22 16:25:23.723381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 870/1664] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:23 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:24.650868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:24.651514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:24.658472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:24.658955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:24.659423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:24.660119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:24.660574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:24.661002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:24.724748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:24.733006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cdc5cde9-368c-4ffc-9344-257bf7b7725a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086321 Aug 22 16:25:24.733574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 795/1665] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:24.743495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:24.744198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:24.750606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:24.751104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:24.751573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:24.752271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:24.752751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:24.753172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:24.881036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:24.889212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b843b0b9-84a4-44ac-a6b5-ecaeb2b88fef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149511 Aug 22 16:25:24.889777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 871/1666] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:24 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:25.754098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:25.754734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:25.757714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:25.762884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:25.763393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:25.763828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:25.764517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:25.764967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:25.765456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:25.829317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:25.837452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-60e3064c-dcb1-4588-9f59-4212681074c8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087206 Aug 22 16:25:25.838007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 796/1667] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:25.911829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:25.912465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:25.914753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=55 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:25.920148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:25.920635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:25.921073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:25.921766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:25.922218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:25.922643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:26.050999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:26.059537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0af57ec1-d813-4450-8774-aa5d1ff99f25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151563 Aug 22 16:25:26.060102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 872/1668] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:25 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:26.858050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:26.858675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:26.864945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:26.865425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:26.865862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:26.866551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:26.867003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:26.867461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:26.885542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:26.930387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:26.939192 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5e91b731-b6da-4efa-be7a-61b654d5b8be tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084997 Aug 22 16:25:26.939783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 797/1669] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:27.082826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:27.083475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:27.090553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:27.091038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:27.091504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:27.092234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:27.092794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:27.093218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:27.226315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:27.235418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-143392ed-cbf3-4f68-b5ed-80509032dad2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.157509 Aug 22 16:25:27.235995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 873/1670] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:27 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:27.960013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:27.960661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:27.967055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:27.967573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:27.968017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:27.968708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:27.969162 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:27.969585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:28.030426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:28.039153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-04c07f99-1f65-4ad0-ad2a-bce1e4bcf25b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083025 Aug 22 16:25:28.039747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 798/1671] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:28.259850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:28.260387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:28.267440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:28.267918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:28.268351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:28.269040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:28.269492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:28.269917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:28.398566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:28.406978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ebb9b05a-c7fd-48fa-824a-9ca477e5cca8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151089 Aug 22 16:25:28.407599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 874/1672] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:28 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:29.060167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:29.060867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:29.067613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:29.068102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:29.068537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:29.069232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:29.069688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:29.070117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:29.133584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:29.141885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b12e241b-cd65-4e9b-9af3-68c18b33f50d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085580 Aug 22 16:25:29.142464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 799/1673] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:29.428022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:29.428569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:29.434917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:29.435427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:29.435863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:29.436550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:29.437011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:29.437495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:29.565201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:29.573320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-337d2518-2443-488b-92d7-4b7f6e62e443 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149273 Aug 22 16:25:29.573888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 875/1674] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:29 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:30.162244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:30.162862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:30.169242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:30.169710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:30.170134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:30.170810 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:30.171252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:30.172204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:30.232830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:30.241403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-56d0ebdb-95b0-4dd2-aa70-43b567dbb7e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083014 Aug 22 16:25:30.241961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 800/1675] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:30.594123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:30.594743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:30.601638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:30.602151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:30.602586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:30.603275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:30.603787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:30.604305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:30.735257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:30.743532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a2173229-e689-4d1a-ba92-c37a7d193f32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153307 Aug 22 16:25:30.744101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 876/1676] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:30 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:31.262881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:31.263508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:31.269853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:31.270329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:31.270756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:31.271475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:31.271905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:31.272319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:31.332224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:31.340536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fde7cc19-1fc5-4aa8-a473-f3d0774145e3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081485 Aug 22 16:25:31.341095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 801/1677] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:31.765623 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:31.766293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:31.772726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:31.773201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:31.773633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:31.774324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:31.774806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:31.775226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:31.901458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:31.910263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8223bd2c-a021-41d1-a5ed-5be4d61cc64a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149125 Aug 22 16:25:31.910827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 877/1678] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:31 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:32.362666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:32.363274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:32.370953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:32.371834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:32.372281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:32.372992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:32.373446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:32.373872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:32.440337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:32.448507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-453124cd-e0b7-4bd5-979e-3aed8a9811b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.090241 Aug 22 16:25:32.449071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 802/1679] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:32.931281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:32.931921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:32.938420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:32.938908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:32.939351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:32.940067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:32.940524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:32.940950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:32.945093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:33.068279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:33.076468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-29aa408b-0e34-45ae-9685-9b8877475e5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149149 Aug 22 16:25:33.077051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 878/1680] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:32 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:33.471857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:33.472479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:33.479184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:33.479705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:33.480142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:33.480845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:33.481295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:33.481741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:33.545164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:33.553960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3c8cc6b1-33db-4649-be81-732d930a4474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087795 Aug 22 16:25:33.554525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 803/1681] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:34.098607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:34.099234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:34.105671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:34.106156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:34.106597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:34.107298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:34.107814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:34.108244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:34.239032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:34.247599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-70bb3adb-d492-4f4c-88be-653fc00fd132 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153094 Aug 22 16:25:34.248173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 879/1682] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:34 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:34.575393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:34.576013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:34.582938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:34.583455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:34.583897 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:34.584594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:34.585051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:34.585471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:34.646633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:34.654920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a0a56cb1-ba12-46d6-91e1-f7f1afa53b74 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083415 Aug 22 16:25:34.655495 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 804/1683] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:35.269066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:35.269703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:35.276307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:35.276791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:35.277229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:35.277928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:35.278382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:35.278805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:35.413932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:35.422328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a5e84e1e-7cf8-4bb9-85b5-6fefa653025d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.157166 Aug 22 16:25:35.422911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 880/1684] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:35 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:35.676290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:35.676935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:35.683379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:35.683870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:35.684307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:35.685001 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:35.685452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:35.685876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:35.750336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:35.758660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-34962e2a-f05f-41db-bef2-d5f1422df5eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086242 Aug 22 16:25:35.759234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 805/1685] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:36.444372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:36.445075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:36.451537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:36.452015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:36.453122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:36.453832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:36.454286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:36.454716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:36.587541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:36.595934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4bacaa2f-1048-4a4e-a5db-0c8262368de2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155472 Aug 22 16:25:36.596503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 881/1686] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:36 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:36.779744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:36.780311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:36.786607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:36.787088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:36.787560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:36.788252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:36.788703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:36.789127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:36.851513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:36.860213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8649004-44a6-4dc5-b2e0-91049f3b79db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084339 Aug 22 16:25:36.860784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 806/1687] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:37.617447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:37.618062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:37.624670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:37.625153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:37.625600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:37.626289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:37.626750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:37.627177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:37.757151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:37.766073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2b16858a-1008-4a39-9a71-9385a6a895b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152538 Aug 22 16:25:37.766649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 882/1688] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:37 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:37.881015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:37.881614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:37.888174 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:37.888657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:37.889101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:37.890309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:37.890771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:37.891195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:38.111449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:38.119669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-709cfe35-0c13-4619-a90f-6de77bf729f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.242517 Aug 22 16:25:38.120231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 807/1689] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:38.787763 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:38.788321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:38.794856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:38.795365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:38.795807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:38.797142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:38.797595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:38.798025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:38.926435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:38.934622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f1d534e6-7d14-4bc4-bdfc-9d71ac7daa48 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150897 Aug 22 16:25:38.935191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 883/1690] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:38 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:39.141607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:39.142221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:39.148764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:39.149250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:39.149692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:39.150389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:39.150845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:39.151271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:39.214606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:39.223671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4c75c8f7-3563-408f-9553-86648ad17f67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086452 Aug 22 16:25:39.224217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 808/1691] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:39.955682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:39.956298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:39.962663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:39.963143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:39.963612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:39.964306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:39.964784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:39.965208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:40.092466 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:40.100991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-56ed560a-7c77-4180-b000-b18c1ad8eb05 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149240 Aug 22 16:25:40.101549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 884/1692] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:39 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:40.244393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:40.244947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:40.251247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:40.251750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:40.252188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:40.252863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:40.253308 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:40.253723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:40.314531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:40.322591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a3a86a40-88f5-467d-bf6a-25bb43dca293 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082093 Aug 22 16:25:40.323148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 809/1693] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:41.122809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:41.123442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:41.129975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:41.130452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:41.130883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:41.131627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:41.132088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:41.132515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:41.264343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:41.273189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-71107e35-eb11-4901-9510-73b60d610d97 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154266 Aug 22 16:25:41.273853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 885/1694] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:41 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:41.343579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:41.344180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:41.350785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:41.351262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:41.351840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:41.352533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:41.352982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:41.353404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:41.413984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:41.422145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-16d05bf2-d106-4759-a5b7-24ec0a184e12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083082 Aug 22 16:25:41.422704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 810/1695] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:42.295666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:42.296300 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:42.303302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:42.303828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:42.304260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:42.304968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:42.305419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:42.305842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:42.433055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:42.441902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8e23ee30-3fa6-4165-a467-87b28c084889 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150044 Aug 22 16:25:42.442475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 886/1696] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:42 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:42.442615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:42.443228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:42.449611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:42.450124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:42.450564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:42.451265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:42.451751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:42.452178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:42.515961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:42.524210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9c32e670-f5a9-4781-bfe2-a63725fc445d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085364 Aug 22 16:25:42.524771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 811/1697] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:42.919601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:25:42.919856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:25:43.464161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:43.464794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:43.472066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:43.472560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:43.473292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:43.474319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:43.474782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:43.475211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:43.545280 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:43.545891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:43.552948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:43.553439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:43.553887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:43.554626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:43.555080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:43.555538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:43.626302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:43.635013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fada3817-c8ad-44fc-ba9c-fad1b10848d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093516 Aug 22 16:25:43.635829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 812/1698] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:43.638738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:43.648751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a536a5cc-7d79-4b65-9a0d-b2d1e2a10797 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.188462 Aug 22 16:25:43.649359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 887/1699] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:43 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:44.656045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:44.656646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:44.663197 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:44.663721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:44.664163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:44.664882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:44.665344 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:44.665766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:44.670430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:44.671044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:44.677988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:44.678474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:44.678910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:44.679644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:44.680103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:44.680523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:44.734771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:44.744449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9ce36f1f-a263-4066-be81-334cb5dbc8b2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.092219 Aug 22 16:25:44.745027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 813/1700] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:44.845272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:44.854367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-edcde43d-6215-44fb-8c6f-10e5459a93fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.187925 Aug 22 16:25:44.854756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 888/1701] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:44 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:25:45.765597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:45.766200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:45.772932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:45.773413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:45.773859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:45.774558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:45.775013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:45.775470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:45.779571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:45.838014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:45.847032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-73f458db-c015-479d-9889-ce62b2ff64e9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085923 Aug 22 16:25:45.847632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 814/1702] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:45.875661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:45.876273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:45.882770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:45.883256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:45.883729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:45.884431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:45.884888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:45.885313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:46.022805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:46.031798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b11f96e0-24a9-422c-964b-51da6d887cd2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.159892 Aug 22 16:25:46.032378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 889/1703] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:45 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:46.868179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:46.868792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:46.875983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:46.876474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:46.876913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:46.877616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:46.878074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:46.878498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:46.941571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:46.949962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5b31e8dd-d6e6-49ed-866c-4ae7e6acd5a0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085670 Aug 22 16:25:46.950526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 815/1704] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:47.053762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:47.054423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:47.061096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:47.061582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:47.062524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:47.063279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:47.063760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:47.064191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:47.193626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:47.203991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c157c3b9-3a37-4ba7-ab4c-68e7866d6f29 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154261 Aug 22 16:25:47.204560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 890/1705] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:47 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:47.971694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:47.972409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:47.979111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:47.979638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:47.980075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:47.980777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:47.981233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:47.981667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:48.042168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:48.050974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bddc3492-2d29-49fd-82aa-9503786b43ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083241 Aug 22 16:25:48.051581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 816/1706] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:48.228092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:48.228680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:48.235922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:48.236413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:48.236852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:48.237557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:48.238014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:48.238440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:48.368672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:48.377620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-10306b20-b091-4e5c-9cac-1b7291945131 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153481 Aug 22 16:25:48.378198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 891/1707] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:48 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:49.072655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:49.073277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:49.080380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:49.080859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:49.090130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:49.090130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:49.090130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:49.090130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:49.144414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:49.153015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-863aaf96-3cc9-416b-bc68-2f697f863db0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084224 Aug 22 16:25:49.153613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 817/1708] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:49.399142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:49.399719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:49.406886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:49.407391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:49.407839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:49.408521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:49.408969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:49.409383 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:49.539519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:49.550282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f04495ab-b3c9-449f-a05f-689ac5b37b4a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155145 Aug 22 16:25:49.550852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 892/1709] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:49 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:50.174178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:50.174781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:50.181163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:50.181641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:50.182071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:50.182757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:50.183203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:50.183655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:50.477289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:50.485962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d4466f65-264a-4857-9030-2961b7c2d66c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.315652 Aug 22 16:25:50.486521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 818/1710] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:50.571434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:50.572046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:50.579241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:50.579755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:50.580205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:50.580910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:50.581368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:50.581793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:50.717253 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:50.726568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c0ec76fd-6cea-4e83-b691-a39cf2d757cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.158992 Aug 22 16:25:50.727140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 893/1711] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:50 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:51.507594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:51.508151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:51.514639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:51.515123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:51.515596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:51.516297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:51.516753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:51.517176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:51.581979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:51.590567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4d4bb67e-9d0c-413a-a39d-49f236ee52ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086934 Aug 22 16:25:51.591154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 819/1712] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:51.748345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:51.748967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:51.755617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:51.756107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:51.756557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:51.757267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:51.757781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:51.758156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:52.038826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:52.042211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:52.047675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cb1e942d-f36d-4eba-8ad8-e8b16028510d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.303192 Aug 22 16:25:52.048227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 894/1713] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:51 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:52.612935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:52.613549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:52.620051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:52.620536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:52.620975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:52.621671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:52.622133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:52.622561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:52.683010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:52.692177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-202d8583-c4e7-4d33-ac7e-b599576c8ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083570 Aug 22 16:25:52.692669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 820/1714] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:53.069861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:53.070463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:53.077394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:53.077880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:53.078341 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:53.079632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:53.080105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:53.080534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:53.211584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:53.220400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0ee700db-44ca-4a5d-8f16-f6aa92c4ca92 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154701 Aug 22 16:25:53.221034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 895/1715] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:53 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:53.713100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:53.713711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:53.720089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:53.720567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:53.721003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:53.721693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:53.722146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:53.722568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:53.787257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:53.795616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-625b948d-29b4-4bba-ac49-0389288eb3a5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086346 Aug 22 16:25:53.796116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 821/1716] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:54.244290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:54.244914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:54.252684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:54.253180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:54.253625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:54.254358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:54.254818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:54.255275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:54.383539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:54.391734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b8039a27-f6f2-4b4e-8749-e1d86fafbef0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151293 Aug 22 16:25:54.392288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 896/1717] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:54 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:54.818840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:54.819524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:54.826226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:54.826703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:54.827134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:54.827870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:54.828323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:54.828748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:54.890719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:54.899150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f4e32cc1-9123-438b-84c4-c64d4df9d28f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084253 Aug 22 16:25:54.899758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 822/1718] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:55.413257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:55.413900 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:55.420313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:55.420801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:55.421235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:55.421926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:55.423054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:55.423520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:55.556035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:55.565067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5990a154-b309-4718-b361-f809176fa1f7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155602 Aug 22 16:25:55.565637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 897/1719] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:55 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:55.920259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:55.920907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:55.923895 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=54 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:55.929772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:55.930260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:55.930695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:55.931429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:55.931884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:55.932307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:55.993111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:56.001391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ee399e68-ae79-41a9-bfae-6389327e3244 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084978 Aug 22 16:25:56.001957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 823/1720] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:56.586760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:56.587383 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:56.589764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=52 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:25:56.594924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:56.595431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:56.595872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:56.596569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:56.597023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:56.597447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:56.726541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:56.735264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-87975801-836c-42e3-af45-c8fa4b05e125 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152210 Aug 22 16:25:56.735859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 898/1721] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:56 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:57.023002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:57.023605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:57.029674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:57.030163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:57.030601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:57.031299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:57.031781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:57.032206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:57.095820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:57.104456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a5c34bb6-9cb0-43be-952e-951697c39884 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085416 Aug 22 16:25:57.105017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 824/1722] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:57.756561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:57.757178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:57.763388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:57.763863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:57.764341 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:57.765052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:57.765501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:57.765918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:57.895234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:57.903392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-89cbd917-6fdb-4a5e-b6db-9bea0acde142 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150733 Aug 22 16:25:57.903947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 899/1723] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:57 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:58.126225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:58.126781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:58.133581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:58.134066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:58.134505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:58.135202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:58.135685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:58.136112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:58.197641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:58.206474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-36cfec05-8fb9-4d4d-b073-7e607dc9395e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084486 Aug 22 16:25:58.207043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 825/1724] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:58.926022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:58.926641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:58.933405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:58.933886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:58.934320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:58.935017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:58.935500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:58.935927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:59.074594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:59.082829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d3d2fa00-59b1-4d35-b84e-362fcf698192 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161298 Aug 22 16:25:59.083411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 900/1725] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:58 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:25:59.227738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:25:59.228293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:25:59.235254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:59.235773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:59.236205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:59.236887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:25:59.237333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:25:59.237748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:25:59.303288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:25:59.311965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-93e7abd0-d936-43de-b24a-42e74852ca1f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088178 Aug 22 16:25:59.312540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 826/1726] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:25:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:00.104961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:00.105595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:00.112817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:00.113342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:00.113817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:00.114587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:00.115089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:00.115592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:00.246759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:00.254175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a1abb992-45c5-44f7-97f5-038f0273de22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153206 Aug 22 16:26:00.254766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 901/1727] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:00 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:00.333477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:00.334067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:00.340502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:00.340978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:00.341411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:00.342103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:00.342556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:00.342979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:00.407730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:00.415965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d136cd1b-3e04-4fd2-ab50-f3bbd641e310 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086496 Aug 22 16:26:00.416530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 827/1728] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:01.275823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:01.276465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:01.282901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:01.283413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:01.283856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:01.284550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:01.285008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:01.285436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:01.415982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:01.424232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16d23815-59a1-4e26-a635-0206527ed5af tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152282 Aug 22 16:26:01.424793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 902/1729] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:01 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:01.437296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:01.438413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:01.444812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:01.445289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:01.445751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:01.446446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:01.446897 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:01.447319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:01.509038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:01.518031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5c215dc2-11cc-4e19-bd59-001e4dccb6a9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084518 Aug 22 16:26:01.518591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 828/1730] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:02.446382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:02.446987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:02.454155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:02.454642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:02.455081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:02.455808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:02.456269 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:02.456699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:02.540414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:02.541000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:02.547724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:02.548212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:02.548685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:02.549402 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:02.549856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:02.550284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:02.601447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:02.609722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1cd68c7c-a0ee-4c72-b092-22d86ed949c8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.167319 Aug 22 16:26:02.610285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 903/1731] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:02 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:02.617651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:02.625904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dfd27df9-4b52-4c5d-952b-5e8dd50a3fa8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089686 Aug 22 16:26:02.626464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 829/1732] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:03.630200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:03.630825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:03.637373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:03.637858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:03.638296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:03.638989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:03.639474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:03.639903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:03.646046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:03.646746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:03.653244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:03.653729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:03.654163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:03.654867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:03.655320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:03.655772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:03.741053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:03.744260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:03.747260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a0086a4d-b430-4e9f-8501-38cce6a37a11 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.105110 Aug 22 16:26:03.751470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 830/1733] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:03.801808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:03.810348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-adbaf7db-93b5-4b21-88a5-6026826f9b59 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.183815 Aug 22 16:26:03.810913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 904/1734] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:03 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:04.768515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:04.769073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:04.775722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:04.776207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:04.776646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:04.777337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:04.777789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:04.778213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:04.832070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:04.832766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:04.839344 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:04.839790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:04.840240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:04.840787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:04.841450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:04.841901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:04.842328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:04.848876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3ea334f8-63ae-4b87-9142-1ebfa7a3b341 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084784 Aug 22 16:26:04.849430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 831/1735] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:04.970649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:04.979174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-21184777-e25c-4daf-83c6-f60ac53cd86d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151675 Aug 22 16:26:04.979767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 905/1736] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:04 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:05.869789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:05.870405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:05.877370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:05.877852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:05.878286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:05.878976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:05.879496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:05.879925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:05.939925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:05.948129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f650fefd-847d-4b36-819b-61bdc2435775 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082212 Aug 22 16:26:05.948690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 832/1737] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:06.000704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:06.001316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:06.007720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:06.008197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:06.008650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:06.009342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:06.009793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:06.010216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:06.143470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:06.151606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-748f7229-f41f-4a1e-8895-641071b62462 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155347 Aug 22 16:26:06.152166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 906/1738] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:05 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:06.970382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:06.970995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:06.977723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:06.978204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:06.978641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:06.979350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:06.979820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:06.980242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:07.040747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:07.048913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-aa0dace7-b280-4280-b0b3-a84973bfea14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082982 Aug 22 16:26:07.049474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 833/1739] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:07.173394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:07.174014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:07.180494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:07.180977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:07.181413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:07.182109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:07.182561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:07.182986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:07.317136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:07.325358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a61d4e61-18d0-461f-950e-ac103af17a25 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155947 Aug 22 16:26:07.325922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 907/1740] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:07 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:08.069933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:08.070563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:08.077167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:08.077648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:08.078085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:08.078813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:08.079268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:08.079719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:08.144989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:08.153175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-02e583f7-4f9a-4bbb-a0b1-07aa0eba27d3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087131 Aug 22 16:26:08.153736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 834/1741] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:08.346778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:08.347312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:08.354115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:08.354598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:08.355041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:08.355773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:08.356240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:08.356672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:08.489947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:08.498124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-20325fdf-f636-4fc8-9700-37c69ade4c1f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155920 Aug 22 16:26:08.498684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 908/1742] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:08 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:09.175368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:09.176129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:09.182595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:09.183077 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:09.183558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:09.184256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:09.184710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:09.185133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:09.244858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:09.253011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-01900827-b921-40fa-869b-ee17434b3b64 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081544 Aug 22 16:26:09.253568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 835/1743] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:09.519537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:09.520112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:09.526894 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:09.527409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:09.527852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:09.528551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:09.529009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:09.529442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:09.659111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:09.667349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ea297116-e1fb-4568-a67d-1a4bcfa05af8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152393 Aug 22 16:26:09.667922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 909/1744] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:09 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:10.274493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:10.275042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:10.282007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:10.282484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:10.282917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:10.283625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:10.284082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:10.284500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:10.344418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:10.352639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c0b02a13-9931-4a46-a279-c55c95d99c0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082106 Aug 22 16:26:10.353194 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 836/1745] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:10.688640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:10.689246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:10.695685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:10.696170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:10.696602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:10.697605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:10.697739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:10.698193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:10.828809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:10.836958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e90c5d8a-58b2-4038-ae48-301eb1e06d96 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152188 Aug 22 16:26:10.837523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 910/1746] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:10 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:11.374057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:11.374611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:11.381175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:11.381655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:11.382090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:11.382777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:11.383225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:11.383674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:11.444871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:11.453146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7222a684-0208-47a5-9fb7-738e5969966e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083001 Aug 22 16:26:11.453698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 837/1747] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:11.858622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:11.859996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:11.866989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:11.867564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:11.868049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:11.868798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:11.869315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:11.869784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:11.886956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:11.996394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:12.004725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-73d369ad-8a2a-4e28-9cdb-0130b969c842 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150413 Aug 22 16:26:12.005282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 911/1748] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:11 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:12.474868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:12.475647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:12.482159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:12.482644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:12.483084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:12.483811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:12.484935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:12.485362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:12.545436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:12.554410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a4ffeb53-ed53-40ea-9941-6f804733f2eb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083721 Aug 22 16:26:12.554956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 838/1749] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:13.025751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:13.026344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:13.033673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:13.034219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:13.034690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:13.035501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:13.035978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:13.036434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:13.170074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:13.178168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a3506165-da87-4d38-9954-f61641b84068 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.156290 Aug 22 16:26:13.178730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 912/1750] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:13 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:13.579106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:13.580287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:13.588691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:13.589173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:13.589609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:13.590301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:13.590752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:13.591177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:13.653705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:13.661732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8f27e809-adb9-4531-a6a3-8c322ba2a265 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089710 Aug 22 16:26:13.662284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 839/1751] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:14.199814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:14.200426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:14.206719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:14.207196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:14.207681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:14.208361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:14.208806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:14.209224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:14.342463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:14.351572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4f9e4770-f099-4f0a-aca0-4db16fd4f980 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155808 Aug 22 16:26:14.352138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 913/1752] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:14 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:14.682561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:14.683207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:14.690022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:14.690495 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:14.690924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:14.691634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:14.692085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:14.692504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:14.752976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:14.761026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-09a6ee8d-2771-481b-9781-b268280e5e0c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082520 Aug 22 16:26:14.761573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 840/1753] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:15.372480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:15.373088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:15.380096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:15.380565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:15.380994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:15.381702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:15.382148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:15.382570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:15.511713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:15.519951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8d0b9e25-e19c-49aa-bd77-7a3da2a208f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151325 Aug 22 16:26:15.520507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 914/1754] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:15 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:15.781832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:15.782412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:15.789496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:15.789977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:15.790414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:15.791106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:15.791607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:15.792034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:15.852818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:15.862761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6c1b9b3e-3418-488f-a8fa-40751320089b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084927 Aug 22 16:26:15.863469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 841/1755] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:16.540432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:16.541060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:16.547946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:16.548424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:16.548854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:16.549533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:16.549978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:16.550397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:16.679860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:16.688671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3f9d791a-ba6f-4f3a-b3a2-3a02acf8f430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151490 Aug 22 16:26:16.689234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 915/1756] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:16 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:16.886382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:16.887010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:16.893328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:16.893805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:16.894235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:16.894914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:16.895381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:16.895805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:16.955603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:16.963600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e1bcd88-f21e-4831-9884-7791c9bda0d4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081071 Aug 22 16:26:16.964150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 842/1757] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:17.709756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:17.710395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:17.716882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:17.717364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:17.717802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:17.718495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:17.718952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:17.719944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:17.850345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:17.858436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8ff744e7-850d-4fe7-812d-cc06bcaf71f4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152555 Aug 22 16:26:17.858995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 916/1758] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:17 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:17.985255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:17.985883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:17.992392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:17.992873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:17.993300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:17.993990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:17.994438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:17.994854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:18.055715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:18.064893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8d3178aa-7df2-4791-aff1-0c45bd13075e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083538 Aug 22 16:26:18.065461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 843/1759] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:18.880136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:18.880774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:18.887199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:18.887705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:18.888141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:18.888826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:18.889278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:18.889700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:19.016525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:19.024726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cecfcf33-64a5-4e1e-b05d-9caa68c56fb1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.148444 Aug 22 16:26:19.025278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 917/1760] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:18 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:19.085752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:19.086365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:19.092817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:19.093297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:19.093736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:19.095031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:19.095526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:19.096016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:19.155916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:19.163960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-12e33d89-5464-4f7f-acd0-53e09eefbe1b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082131 Aug 22 16:26:19.164516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 844/1761] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:20.047533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:20.048155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:20.054654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:20.055135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:20.055613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:20.056310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:20.056764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:20.057190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:20.184981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:20.185387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:20.187027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:20.192353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:20.192835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:20.193274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:20.193973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:20.194431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:20.194854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:20.195649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c8ec997d-0e99-4f4c-8451-4383141e3b42 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152011 Aug 22 16:26:20.196220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 918/1762] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:20 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:20.255734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:20.263842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c20a410b-365f-4740-8f8d-3113aeddd57c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082876 Aug 22 16:26:20.264399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 845/1763] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:21.217438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:21.218055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:21.225380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:21.225864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:21.226301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:21.226996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:21.227486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:21.227916 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:21.285266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:21.286041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:21.292382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:21.292861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:21.293295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:21.293987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:21.294438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:21.294862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:21.374083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:21.382901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8361849-340d-42de-a6f8-f359f3cd8b90 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.102308 Aug 22 16:26:21.383525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 846/1764] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:21.392085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:21.399680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9dbd3fe0-441c-415b-bc50-ba0634ab0de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.186175 Aug 22 16:26:21.400229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 919/1765] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:21 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:22.404408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:22.405005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:22.412010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:22.412481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:22.412910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:22.413589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:22.414032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:22.414486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:22.420581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:22.421198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:22.428095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:22.428578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:22.429016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:22.429713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:22.430169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:22.430597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:22.433349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:22.492134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:22.500109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-afd94621-71e9-4fb7-971e-bb2962835d1d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.099543 Aug 22 16:26:22.501241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 847/1766] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:22.579010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:22.587147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1a3e14ab-bf62-4555-bede-11143150394e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170454 Aug 22 16:26:22.587729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 920/1767] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:22 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:23.522348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:23.522959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:23.529388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:23.529872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:23.530311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:23.531003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:23.531500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:23.532581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:23.596222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:23.604849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-945a56fb-9501-4baa-baa4-af3df4682bad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086388 Aug 22 16:26:23.605405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 848/1768] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:23.609298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:23.610546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:23.616631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:23.617111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:23.617550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:23.618242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:23.618701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:23.619127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:23.748019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:23.756175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ad6314cd-9d7a-4a3e-83c5-d7da4014605f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150792 Aug 22 16:26:23.756740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 921/1769] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:23 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:24.276778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:26:24.277045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:26:24.626022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:24.626629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:24.632997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:24.633472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:24.633903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:24.634583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:24.635028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:24.635480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:24.697014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:24.705147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c93d592d-ab72-41c4-b2e2-c5a40bd721dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083046 Aug 22 16:26:24.705706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 849/1770] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:24.777191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:24.777804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:24.784870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:24.785344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:24.785779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:24.786463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:24.786918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:24.787353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:24.922067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:24.930268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ac85d6d8-bf7b-4b2b-81c4-fbf9db664f34 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.156936 Aug 22 16:26:24.930822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 922/1771] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:24 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:25.726405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:25.727050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:25.733666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:25.734142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:25.735067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:25.735814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:25.736295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:25.736744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:25.796860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:25.805402 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-64153f43-29de-4eb5-9410-42b340272473 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083171 Aug 22 16:26:25.805954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 850/1772] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:25.950671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:25.951288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:25.957712 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:25.958188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:25.958622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:25.959310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:25.959789 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:25.960213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:26.088353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:26.096528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e01e8929-7be6-4969-b743-0208e813ad6d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149767 Aug 22 16:26:26.097084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 923/1773] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:25 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:26.826619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:26.827239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:26.829277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=56 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:26.834289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:26.834771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:26.835223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:26.835941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:26.836401 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:26.836819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:26.900705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:26.909340 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6f43a7d1-7bb5-4450-acd4-1481cc9a3cdf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086561 Aug 22 16:26:26.909895 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 851/1774] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:27.117696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:27.118245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:27.120259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=52 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:27.125517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:27.126005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:27.126445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:27.127148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:27.127640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:27.128073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:27.254262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:27.262902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a50fb0fa-ad7a-4572-921e-86dc379c557a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.148947 Aug 22 16:26:27.263353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 924/1775] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:27 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:27.929919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:27.930521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:27.936922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:27.937400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:27.937837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:27.938524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:27.938974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:27.939421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:27.999745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:28.007864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e3d73ae6-4227-49f9-a61b-48dad2b5f84d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081771 Aug 22 16:26:28.008420 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 852/1776] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:28.285166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:28.285883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:28.292427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:28.292926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:28.293342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:28.294043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:28.294499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:28.294925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:28.426531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:28.434791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8c426de5-d18f-4515-bc9c-4fc9e1f245ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154059 Aug 22 16:26:28.435379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 925/1777] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:28 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:29.029619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:29.030237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:29.036720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:29.037205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:29.037640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:29.038331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:29.038793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:29.039218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:29.099920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:29.107993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c023d839-3681-4114-829a-0be0eb916cdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082248 Aug 22 16:26:29.108550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 853/1778] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:29.456225 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:29.456844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:29.463318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:29.463833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:29.464272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:29.464974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:29.465438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:29.465895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:29.594506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:29.603416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7c53e90c-ac08-4214-b2ff-f5af3a11e848 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151099 Aug 22 16:26:29.603981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 926/1779] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:29 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:30.129018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:30.129685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:30.136023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:30.136507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:30.136987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:30.137667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:30.138121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:30.138546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:30.201703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:30.209917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f2451a1a-e4fc-4b34-879d-6da554e58521 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084764 Aug 22 16:26:30.210477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 854/1780] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:30.625490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:30.626103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:30.632667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:30.633147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:30.633579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:30.634265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:30.634713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:30.635133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:30.764243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:30.772990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d1b40264-de60-439a-a69f-c9995a62f653 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151384 Aug 22 16:26:30.773547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 927/1781] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:30 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:31.231314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:31.231967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:31.238833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:31.239315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:31.239782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:31.240476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:31.240942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:31.241365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:31.301101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:31.309205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d958f946-5f2e-43e4-85ca-1a0b528c2fda tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081849 Aug 22 16:26:31.309748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 855/1782] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:31.794032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:31.794615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:31.801698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:31.802178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:31.802620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:31.803309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:31.803792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:31.804233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:31.808122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:31.933880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:31.941997 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5d8cff4c-482b-447c-9e8e-2375e9f5b3a4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151933 Aug 22 16:26:31.942580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 928/1783] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:31 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:32.330560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:32.331175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:32.338408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:32.338894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:32.339352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:32.340058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:32.340528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:32.340937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:32.401966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:32.410153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-16031b29-58b6-4507-a1a7-8ce6836b4cee tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084171 Aug 22 16:26:32.410714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 856/1784] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:32.963141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:32.963790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:32.970325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:32.970808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:32.971244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:32.971964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:32.972423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:32.972850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:33.100332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:33.109029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3f2a4c45-9dfb-44ca-b8e1-fa0b5d2b65b9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149727 Aug 22 16:26:33.109593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 929/1785] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:32 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:33.430022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:33.430635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:33.437297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:33.437774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:33.438207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:33.438891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:33.439506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:33.439926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:33.505122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:33.513482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4ec2d1c3-b329-4480-bab8-8ea9b334b119 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087259 Aug 22 16:26:33.514049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 857/1786] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:34.131229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:34.131871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:34.138400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:34.138884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:34.139321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:34.140040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:34.140499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:34.140926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:34.267116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:34.275295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-78f7a89a-2379-46b4-8cd9-14517c6ca698 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.147947 Aug 22 16:26:34.275879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 930/1787] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:34 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:34.535934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:34.536577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:34.543029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:34.543536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:34.543976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:34.544695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:34.545144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:34.545569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:34.606486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:34.614629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6992c427-71ff-440a-91a0-656be4ff964d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082729 Aug 22 16:26:34.615183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 858/1788] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:35.296604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:35.297249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:35.304246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:35.304734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:35.305171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:35.305859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:35.306303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:35.306728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:35.436792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:35.444963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ca411fda-7a4b-452f-92dd-e4fa72fb28f6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152281 Aug 22 16:26:35.445527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 931/1789] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:35 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:35.636015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:35.636633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:35.643018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:35.643542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:35.643978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:35.644692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:35.645146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:35.645567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:35.710589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:35.718758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-909e41ff-a839-44d9-ab13-ae3ff69729f8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086645 Aug 22 16:26:35.719353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 859/1790] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:36.466345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:36.466725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:36.472861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:36.473604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:36.474039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:36.474726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:36.475176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:36.475621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:36.603354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:36.611970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-afcf71f1-1f1e-4378-a4d6-75038229b6d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149632 Aug 22 16:26:36.612541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 932/1791] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:36 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:36.740238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:36.740786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:36.747177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:36.747694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:36.748126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:36.748807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:36.749252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:36.749672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:36.812812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:36.820926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8bf0a783-1a70-4a37-9d99-4e0c7fb0b5e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085255 Aug 22 16:26:36.821476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 860/1792] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:37.632675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:37.633299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:37.639720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:37.640205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:37.640645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:37.641337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:37.641796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:37.642224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:37.771759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:37.779933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ab6b540e-cf8e-4eca-9e51-8b6083913d7e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151098 Aug 22 16:26:37.780492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 933/1793] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:37 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:37.841705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:37.842320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:37.849643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:37.850147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:37.850567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:37.851259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:37.851743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:37.852167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:37.912610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:37.920706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e23f0266-e14f-4b68-b4fd-cec718595cb1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082890 Aug 22 16:26:37.921270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 861/1794] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:38.801998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:38.802547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:38.809020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:38.809501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:38.809941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:38.810633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:38.811092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:38.811546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:38.942229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:38.942610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:38.943262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:38.949646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:38.950158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:38.950601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:38.950717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f7b27f87-ae63-47fe-be77-2606a7ce1a8f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153116 Aug 22 16:26:38.951196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 934/1795] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:38 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:38.951311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:38.951775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:38.952203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:39.012331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:39.020483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cacdde4b-698f-4678-b6e0-43569e452f4b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082345 Aug 22 16:26:39.021062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 862/1796] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:39.971250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:39.971939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:39.978617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:39.979098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:39.979578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:39.980276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:39.980731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:39.981158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:40.041542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:40.042259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:40.049052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:40.049577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:40.050018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:40.051263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:40.051753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:40.052183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:40.122378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:40.131073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3826a2e9-1edc-4dbf-bca9-85e2496df348 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093471 Aug 22 16:26:40.131671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 863/1797] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:40.136792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:40.145131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8613fd28-6794-4ec6-a734-da777c23e7aa tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.177778 Aug 22 16:26:40.145691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 935/1798] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:39 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:41.151828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:41.152470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:41.158880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:41.159397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:41.160506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:41.161200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:41.161660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:41.162083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:41.166185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:41.166695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:41.167419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:41.174699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:41.175193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:41.175672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:41.176384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:41.176846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:41.177398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:41.228683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:41.236934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-495676d3-8249-4439-bcc7-668daf8dc0d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088976 Aug 22 16:26:41.237728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 864/1799] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:41.321832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:41.329944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b48af033-e072-4819-b9fe-6ffc425fe517 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.167173 Aug 22 16:26:41.330514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 936/1800] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:41 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:42.257612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:42.258211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:42.264636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:42.265114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:42.265569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:42.266257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:42.266742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:42.267159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:42.326335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:42.334987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c967b5a3-5c10-456c-9500-9882c0877667 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081232 Aug 22 16:26:42.335574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 865/1801] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:42.352062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:42.352676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:42.358924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:42.359435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:42.359870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:42.360548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:42.360995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:42.361410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:42.491079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:42.499192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bc4f4a65-0b55-40f8-8074-4882a881e134 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151690 Aug 22 16:26:42.499784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 937/1802] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:42 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:43.356493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:43.357139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:43.364024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:43.364491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:43.364920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:43.365604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:43.366050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:43.366467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:43.426474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:43.434532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-874ca706-bc31-4cd7-89c3-4d784d3e68d5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081904 Aug 22 16:26:43.435092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 866/1803] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:43.520131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:43.520751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:43.527128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:43.527709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:43.528147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:43.528841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:43.529295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:43.529725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:43.658829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:43.667584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4df3910e-cc87-4742-aea9-f39994f4f1f8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151267 Aug 22 16:26:43.668151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 938/1804] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:43 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:44.456210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:44.457399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:44.463862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:44.464331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:44.464758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:44.465435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:44.466006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:44.466427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:44.527652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:44.535845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-85966d9e-66a1-4549-bfb7-39f22e33675f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083621 Aug 22 16:26:44.536411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 867/1805] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:44.689056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:44.689665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:44.696697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:44.697170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:44.697598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:44.698278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:44.698734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:44.699168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:44.827780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:44.836033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0e06a6c4-389d-4a9f-b1c8-5603d8e1a3ea tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150857 Aug 22 16:26:44.836606 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 939/1806] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:44 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:45.556744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:45.557362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:45.563801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:45.564284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:45.564729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:45.565411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:45.565863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:45.566289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:45.626443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:45.634620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-282432b5-7ca5-468c-bd63-18487149dd80 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081746 Aug 22 16:26:45.635188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 868/1807] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:45.857487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:45.858107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:45.864543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:45.865027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:45.865468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:45.866164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:45.866624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:45.867054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:45.994748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:46.004299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4f322dc0-8fb5-4dac-af92-b6da67aab0d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150702 Aug 22 16:26:46.004861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 940/1808] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:45 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:46.655772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:46.656438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:46.663233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:46.663864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:46.664297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:46.664978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:46.665422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:46.665837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:46.725996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:46.734029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-848a7561-c534-4c41-860f-15f93dda606d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082288 Aug 22 16:26:46.734585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 869/1809] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:47.025286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:47.025832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:47.032181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:47.032663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:47.033102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:47.033790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:47.034247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:47.035311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:47.163747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:47.171862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d4e8cd04-73b8-4029-8593-a7fdd33027da tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150622 Aug 22 16:26:47.172420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 941/1810] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:47 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:47.755985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:47.756596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:47.763109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:47.763619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:47.764060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:47.764752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:47.765204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:47.765626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:47.827312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:47.835492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57877225-5ded-492e-98dc-67c86a71970d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084015 Aug 22 16:26:47.836048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 870/1811] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:48.192715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:48.193272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:48.199632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:48.200116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:48.200547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:48.201228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:48.201685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:48.202103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:48.327139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:48.335894 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bb0e0767-4f21-445a-a685-492aa6b49424 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.147084 Aug 22 16:26:48.336471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 942/1812] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:48 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:48.856333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:48.856945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:48.863511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:48.864031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:48.864468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:48.865183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:48.865636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:48.866062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:48.926045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:48.934143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-38dad500-4b65-4588-9b63-3feb8dad5333 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081733 Aug 22 16:26:48.934945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 871/1813] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:49.357691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:49.358284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:49.365139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:49.365614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:49.366043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:49.366724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:49.367172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:49.367615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:49.497248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:49.505431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c0eb8ae0-5c58-462f-92cc-8787d7585ee2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151526 Aug 22 16:26:49.505995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 943/1814] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:49 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:49.955355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:49.956518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:49.962803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:49.963277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:49.963738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:49.964419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:49.964867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:49.965287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:50.025858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:50.034050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4596cc90-e05b-4e1d-a890-cdb88d480887 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082540 Aug 22 16:26:50.035198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 872/1815] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:50.526059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:50.526678 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:50.533243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:50.533731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:50.534171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:50.534873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:50.535363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:50.535786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:50.664379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:50.667845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:50.673830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8840fd10-8baf-41df-8f60-88c01d01a049 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151608 Aug 22 16:26:50.674396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 944/1816] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:50 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:51.056196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:51.056808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:51.063375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:51.063867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:51.064304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:51.065000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:51.065454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:51.065883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:51.129466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:51.137705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-95017296-abfa-40b1-ba54-2d67f27053fe tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085371 Aug 22 16:26:51.138268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 873/1817] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:51.695465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:51.696133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:51.702885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:51.703406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:51.703853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:51.704546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:51.705004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:51.705434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:51.832049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:51.840211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-80ee47fb-3814-4c32-9971-c50a0eb02246 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.148693 Aug 22 16:26:51.840773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 945/1818] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:51 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:52.158051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:52.158586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:52.164955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:52.165431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:52.165863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:52.166543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:52.166992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:52.167434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:52.226837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:52.234764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9a5f5e22-1351-445a-a848-c01385790860 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.080686 Aug 22 16:26:52.235339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 874/1819] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:52.861360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:52.861961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:52.868354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:52.868833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:52.869267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:52.869956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:52.870407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:52.870835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:53.005305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:53.013580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-28745475-6e8c-4451-b720-377172511a4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.156128 Aug 22 16:26:53.014149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 946/1820] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:52 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:53.256522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:53.257108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:53.263390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:53.263905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:53.264331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:53.265020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:53.265470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:53.265893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:53.326704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:53.335497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8b87b488-073e-402b-9cc6-aeb56c4ea1d6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083457 Aug 22 16:26:53.336058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 875/1821] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:54.034956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:54.035599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:54.041930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:54.042407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:54.042839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:54.043570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:54.044025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:54.044449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:54.169753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:54.177956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ca480761-56cd-4a6c-8467-768b5dfc9b4c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.146920 Aug 22 16:26:54.178521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 947/1822] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:54 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:54.356521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:54.357128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:54.363994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:54.364470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:54.364899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:54.365575 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:54.366018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:54.366435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:54.429052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:54.437133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-44104585-9c3e-4976-88ad-1b4d5e8200c1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084467 Aug 22 16:26:54.437688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 876/1823] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:26:55.199847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:55.200462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:55.207372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:55.207853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:55.208279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:55.208955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:55.209403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:55.209820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:55.337692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:55.345840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b8e6a660-b1ed-4e89-acbe-77c98b611557 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149942 Aug 22 16:26:55.346404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 948/1824] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:55 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:55.458395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:55.458948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:55.465290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:55.465769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:55.466204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:55.466890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:55.467354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:55.467790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:55.528188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:55.536336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-73e3a2f4-ba77-463b-b4cf-162a26cc6772 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082456 Aug 22 16:26:55.536901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 877/1825] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:56.368513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:56.369096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:56.375438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:56.375914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:56.376345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:56.377030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:56.377479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:56.377923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:56.511517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:56.519817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4ab27a87-f3cf-4236-bd27-ff9e7a8e9f9a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155247 Aug 22 16:26:56.520382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 949/1826] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:56 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:56.557149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:56.557747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:56.563979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:56.564466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:56.564904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:56.565721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:56.566217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:56.566644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:56.627422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:56.635693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d648b577-54c6-4079-aca2-02217127310f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082571 Aug 22 16:26:56.636264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 878/1827] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:57.540812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:57.541439 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:57.543552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=52 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:57.549025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:57.550003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:57.550475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:57.551166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:57.551696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:57.552085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:57.657045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:57.657656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:57.660067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=56 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:57.665304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:57.665801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:57.666242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:57.666946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:57.667430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:57.667858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:57.756637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:57.765008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-48bc73ff-5779-4b3c-8bd8-7058796a1b3a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.111819 Aug 22 16:26:57.765580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 879/1828] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:57.768784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:57.777183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0aaed05b-8470-4ed1-87ef-3c607593b906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.240257 Aug 22 16:26:57.777932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 950/1829] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:57 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:58.655784 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:58.656288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:58.662936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.663607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.663861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.664559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.665009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.665430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.691766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:26:58.694604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:26:58.718888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-94c3b0b5-9eb7-4d9e-92cc-75016ca55057 req-435f0dcb-38e6-4735-a485-53dd3015f5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d19e272-2528-4d1f-b92b-34722e8821a9", "tag": "33f36485-abda-46f9-941b-aaee4f7dccc7"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:26:58.731227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-94c3b0b5-9eb7-4d9e-92cc-75016ca55057 req-435f0dcb-38e6-4735-a485-53dd3015f5f3 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.731841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-94c3b0b5-9eb7-4d9e-92cc-75016ca55057 req-435f0dcb-38e6-4735-a485-53dd3015f5f3 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.732349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-94c3b0b5-9eb7-4d9e-92cc-75016ca55057 req-435f0dcb-38e6-4735-a485-53dd3015f5f3 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.745120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-94c3b0b5-9eb7-4d9e-92cc-75016ca55057 req-435f0dcb-38e6-4735-a485-53dd3015f5f3 service nova] Creating event network-changed:33f36485-abda-46f9-941b-aaee4f7dccc7 for instance 4d19e272-2528-4d1f-b92b-34722e8821a9 on hv-cinder-85400 Aug 22 16:26:58.751549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-94c3b0b5-9eb7-4d9e-92cc-75016ca55057 req-435f0dcb-38e6-4735-a485-53dd3015f5f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100940 Aug 22 16:26:58.752553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 951/1830] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:26:58.786689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:58.787443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:58.793066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-66801aed-08f3-463c-8573-0ef82a795080 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 204 len: 0 microversion: 2.1 time: 0.146587 Aug 22 16:26:58.793685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 880/1831] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:26:58 2022] DELETE /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 16:26:58.800980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:58.801690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:58.805833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.806779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.807652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.808141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.808647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.809081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.809607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.809789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.810351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.810547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.810887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.812057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.910781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:58.921821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-33f61d5c-da78-4774-9511-951623399235 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.139778 Aug 22 16:26:58.922834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 952/1832] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:58.928041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:58.928715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:58.934698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.935496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.936051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.937312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:58.938344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:58.938344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:58.991602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:58.996224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-605eb198-73cf-4544-bc6c-bde10464c255 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.201584 Aug 22 16:26:58.996794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 881/1833] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:58 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:59.084252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:26:59.092358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0064e24f-8bb4-4ec1-baa0-f0f4fa08137d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1576 microversion: 2.1 time: 0.168262 Aug 22 16:26:59.092938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 953/1834] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:58 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:26:59.945063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:26:59.945766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:26:59.952233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:59.952715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:59.953355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:26:59.954068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:26:59.954516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:26:59.955259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:00.018868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:00.019546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:00.026049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:00.026527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:00.027181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:00.027911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:00.028367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:00.028788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:00.031599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:00.041692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0179b458-9df1-4933-ba53-a29438ab2c32 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.100317 Aug 22 16:27:00.042277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 882/1835] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:26:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:00.114618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:00.116183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:00.125176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:00.125705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:00.126307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:00.127259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:00.128288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:00.128732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:00.219882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:00.229111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a48c13eb-c525-4178-bdf4-fbe4c4d509e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1389 microversion: 2.1 time: 0.118890 Aug 22 16:27:00.229693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 883/1836] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:00 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1389 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:00.250515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:00.259418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-833bc502-915d-414a-a3d7-4c3620d97180 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.245114 Aug 22 16:27:00.260067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 954/1837] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:00 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:00.767656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-8210a8ad-adc7-4b99-bc64-3384d2a9c6b7 req-12ef61cc-ae4f-4b85-a70c-92592421a52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d19e272-2528-4d1f-b92b-34722e8821a9", "name": "network-vif-deleted", "tag": "33f36485-abda-46f9-941b-aaee4f7dccc7"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:27:00.777017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8210a8ad-adc7-4b99-bc64-3384d2a9c6b7 req-12ef61cc-ae4f-4b85-a70c-92592421a52d service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:00.777492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8210a8ad-adc7-4b99-bc64-3384d2a9c6b7 req-12ef61cc-ae4f-4b85-a70c-92592421a52d service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:00.777922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8210a8ad-adc7-4b99-bc64-3384d2a9c6b7 req-12ef61cc-ae4f-4b85-a70c-92592421a52d service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:00.788904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-8210a8ad-adc7-4b99-bc64-3384d2a9c6b7 req-12ef61cc-ae4f-4b85-a70c-92592421a52d service nova] Creating event network-vif-deleted:33f36485-abda-46f9-941b-aaee4f7dccc7 for instance 4d19e272-2528-4d1f-b92b-34722e8821a9 on hv-cinder-85400 Aug 22 16:27:00.793717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-8210a8ad-adc7-4b99-bc64-3384d2a9c6b7 req-12ef61cc-ae4f-4b85-a70c-92592421a52d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029884 Aug 22 16:27:00.794278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 884/1838] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:27:01.063445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:01.064070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:01.070618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:01.071101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:01.071564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:01.072258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:01.072714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:01.073141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:01.133992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:01.142233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-32c9483b-3f9b-4636-9641-e50096ed82f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082764 Aug 22 16:27:01.142802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 955/1839] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:01.252268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:01.253573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:01.260233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:01.260720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:01.261150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:01.261851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:01.262297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:01.262714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:01.280965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:01.281596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:01.287478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:01.287964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:01.288403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:01.289133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:01.289591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:01.290017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:01.329974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:01.338077 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4b1dfd77-45bf-4266-ae16-a1ad94947c56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090620 Aug 22 16:27:01.338652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 885/1840] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:01 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:01.423374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:01.435215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d21254a4-74bc-44e9-b3b2-d7133ae5b8a9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.158077 Aug 22 16:27:01.435828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 956/1841] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:01 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:02.164180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:02.164811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:02.171033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:02.171559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:02.171994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:02.172706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:02.173157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:02.173581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:02.238982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:02.247565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4f12c272-ed4d-44e1-8838-097d8b8c71f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087234 Aug 22 16:27:02.248148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 886/1842] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:02.358947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:02.359578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:02.366905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:02.367427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:02.367865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:02.368568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:02.369404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:02.369558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:02.435032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:02.443782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a41396b9-d113-4238-93c5-dc1a574675be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088616 Aug 22 16:27:02.444362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 957/1843] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:02 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:02.457087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:02.457728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:02.464347 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:02.464837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:02.465279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:02.465982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:02.466435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:02.466857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:02.608649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:02.616872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-451a669a-cc5f-4020-9f36-f2946c3b6e32 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.163735 Aug 22 16:27:02.617461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 887/1844] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:02 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:03.270956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:03.271592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:03.278653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:03.279155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:03.279621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:03.280680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:03.281141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:03.281566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:03.344977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:03.353586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-42cb05d2-d2dc-49f7-94a6-550f0afedb49 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088374 Aug 22 16:27:03.354174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 958/1845] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:03.464948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:03.465578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:03.472147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:03.472621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:03.473320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:03.474018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:03.474871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:03.474871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:03.537116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:03.545210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2ccebc26-6fe6-4ea8-a1f5-83c096bd584c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084192 Aug 22 16:27:03.545785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 888/1846] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:03 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:03.638198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:03.638821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:03.645535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:03.646022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:03.646462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:03.647162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:03.647652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:03.648081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:03.791097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:03.802946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-215e04c9-030e-4899-86ae-a0cf8bdb6e82 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168350 Aug 22 16:27:03.803730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 959/1847] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:03 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:04.377540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:04.378220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:04.384383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:04.384874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:04.385319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:04.386027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:04.386480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:04.386910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:04.448880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:04.457836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f2ddb34d-0989-4790-b0a1-9935b9f36adf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086396 Aug 22 16:27:04.458407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 889/1848] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:04.566964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:04.567496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:04.573781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:04.574323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:04.574775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:04.575538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:04.576000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:04.576429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:04.639081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:04.648168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aced169d-d6ed-4d82-bd0a-2cfd1d2e4fbf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085891 Aug 22 16:27:04.648740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 960/1849] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:04 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:04.828535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:04.829154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:04.835633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:04.836123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:04.836564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:04.837269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:04.837727 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:04.838187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:04.974755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:04.983019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2839a0c1-9851-4d66-b839-b7ca03c812d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.158389 Aug 22 16:27:04.983613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 890/1850] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:04 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:05.478764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:05.479421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:05.485425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:05.485899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:05.486329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:05.487645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:05.488095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:05.488513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:05.550327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:05.558488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-72f11764-eb85-453b-9cdb-1b6f4cf396c3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083557 Aug 22 16:27:05.559051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 961/1851] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:05.668587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:05.669194 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:05.675109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:05.675617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:05.676053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:05.676737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:05.677187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:05.677606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:05.738436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:05.746138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7a342e3f-fbb9-4893-8835-b5d749358607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081403 Aug 22 16:27:05.746712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 891/1852] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:05 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:06.005685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:06.006257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:06.012687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:06.013167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:06.013607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:06.014305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:06.014757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:06.015177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:06.020043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:06.154101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:06.162406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-08c6807c-a9fb-4c78-9162-98db73b9e007 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161259 Aug 22 16:27:06.162978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 962/1853] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:05 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:06.578782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:06.579410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:06.586941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:06.587622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:06.588190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:06.589129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:06.589757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:06.590371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:06.655987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:06.664276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a1b4a565-02f8-4023-92a5-ea682b25d220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089465 Aug 22 16:27:06.664835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 892/1854] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:06.766416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:06.766982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:06.773373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:06.773861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:06.774299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:06.774998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:06.775493 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:06.775919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:06.838027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:06.845777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2829227e-8dfd-4bef-bebd-4b89ed598426 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083433 Aug 22 16:27:06.846844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 963/1855] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:06 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:07.183471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:07.184084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:07.190009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:07.190490 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:07.190929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:07.191647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:07.192100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:07.192525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:07.328411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:07.337122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1169daea-b642-4a5f-a258-7f44eba94191 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.157589 Aug 22 16:27:07.337676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 893/1856] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:07 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:07.685542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:07.686138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:07.693126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:07.693608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:07.694043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:07.694735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:07.695192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:07.695651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:07.756844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:07.764859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2864e602-248b-45ca-8eb0-204eea54f1e5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083196 Aug 22 16:27:07.765431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 964/1857] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:07.867170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:07.867822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:07.874359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:07.874842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:07.875287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:07.876002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:07.876458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:07.876885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:07.937593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:07.945970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6d5efcd9-2e0c-46ba-9853-35a319c4e0eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082625 Aug 22 16:27:07.946538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 894/1858] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:07 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:08.358990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:08.359620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:08.366535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:08.367019 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:08.367485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:08.368213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:08.368668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:08.369094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:08.497730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:08.506549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8e68bbca-fe02-4bd4-be5f-0067aaa49cf0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151377 Aug 22 16:27:08.507127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 965/1859] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:08 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:08.785977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:08.786594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:08.792582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:08.793060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:08.793495 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:08.794188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:08.794643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:08.795068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:08.858595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:08.867318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f3ee10f6-4689-4c12-b002-74b910eca158 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085213 Aug 22 16:27:08.868305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 895/1860] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:08.966981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:08.967578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:08.974803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:08.975287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:08.975760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:08.976452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:08.976934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:08.977355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:09.039083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:09.046908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e48c9d59-8360-4ad4-99be-6595bd305933 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083947 Aug 22 16:27:09.047505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 966/1861] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:08 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:09.528073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:09.528690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:09.535129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:09.535642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:09.536075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:09.536777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:09.537224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:09.537647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:09.557920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:09.669627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:09.678486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-04f32e30-e5d7-4458-8fbc-12e8db8699df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154241 Aug 22 16:27:09.679059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 896/1862] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:09 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:09.889069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:09.889727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:09.895872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:09.896389 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:09.896828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:09.897553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:09.898008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:09.898457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:09.963592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:09.972854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6894912b-fdc1-45a2-baec-b293fa919b45 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087635 Aug 22 16:27:09.973714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 967/1863] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:10.068161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:10.068827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:10.074629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:10.075105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:10.075598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:10.076289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:10.076737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:10.077155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:10.138187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:10.146753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-06cd726c-b6f7-4d3d-a4b9-72ead93f1ac7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082641 Aug 22 16:27:10.147342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 897/1864] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:10 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:10.700298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:10.700917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:10.708846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:10.709352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:10.709876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:10.710843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:10.711599 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:10.712071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:10.846693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:10.855559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9591a7a6-7c40-4c98-97da-e8315f1ef26f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.159035 Aug 22 16:27:10.856135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 968/1865] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:10 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:10.994058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:10.994675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:11.001237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:11.001716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:11.002208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:11.003461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:11.003915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:11.004336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:11.068696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:11.077463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e77f3ab9-4117-4f72-a51c-4378a55748df tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087392 Aug 22 16:27:11.078052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 898/1866] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:11.169345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:11.169967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:11.178047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:11.179851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:11.180816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:11.181579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:11.182069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:11.182545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:11.251601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:11.259664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b8f3fdfb-01d3-4b36-b733-42819f209784 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095406 Aug 22 16:27:11.260797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 969/1867] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:11 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:11.876296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:11.876916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:11.883063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:11.883588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:11.884027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:11.884728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:11.885185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:11.885612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:12.014199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:12.023129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-43b6c496-6c82-40cd-aa0b-51044bf37544 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150749 Aug 22 16:27:12.023725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 899/1868] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:11 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:12.098390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:12.098996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:12.104891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:12.105368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:12.105798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:12.106480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:12.106928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:12.107365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:12.168270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:12.177398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b3e36846-df30-4f19-977d-12e8f78218c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083289 Aug 22 16:27:12.177978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 970/1869] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:12.281976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:12.282615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:12.292176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:12.292645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:12.293074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:12.293756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:12.294218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:12.294626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:12.359220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:12.367345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8417d406-c14d-4d0d-8f14-eb1cade3ae98 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089195 Aug 22 16:27:12.367921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 900/1870] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:12 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:13.047593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:13.048228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:13.055505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:13.056003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:13.056444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:13.057169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:13.057628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:13.058058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:13.202115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:13.203094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:13.204033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:13.214123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-134b9c90-38f4-44ff-b936-42edeb471259 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170447 Aug 22 16:27:13.214422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:13.214715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 971/1871] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:13 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:13.215145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:13.215981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:13.217298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:13.218140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:13.218938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:13.308680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:13.318469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7f47f732-a3fa-4760-b7dd-8b9d20ad4344 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.123367 Aug 22 16:27:13.319169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 901/1872] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:13.392211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:13.393608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:13.404679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:13.405558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:13.406343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:13.407653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:13.408479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:13.409261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:13.478608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:13.487390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8ce06ec8-b1c9-4e57-ac75-cd716a7143d1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.101875 Aug 22 16:27:13.487988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 972/1873] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:13 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:14.236761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:14.237486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:14.244612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:14.245152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:14.245633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:14.246388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:14.247168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:14.247717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:14.341775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:14.342755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:14.353204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:14.354061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:14.354793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:14.356036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:14.356807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:14.357533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:14.393415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:14.403834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-015c3427-183d-4515-aac8-5a15b53579a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170934 Aug 22 16:27:14.404772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 902/1874] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:14 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:14.441102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:14.450162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e9ae539-b666-42f0-81cd-70639bc0ef52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.114764 Aug 22 16:27:14.450761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 973/1875] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:14.508454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:14.509079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:14.515245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:14.515775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:14.516211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:14.516935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:14.517389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:14.518437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:14.605395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:14.614252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4f730825-661b-424d-a98d-3067d3a184f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.110084 Aug 22 16:27:14.614841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 903/1876] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:14 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:15.436473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:15.437490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:15.445743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:15.446232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:15.446666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:15.447398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:15.447851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:15.448270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:15.485445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:15.486683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:15.497240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:15.498177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:15.498907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:15.500133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:15.500986 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:15.501791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:15.603900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:15.618509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dd471d8f-269e-4e05-9837-e9cc5f911503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.139423 Aug 22 16:27:15.619506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 904/1877] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:15.628446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:15.639316 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-07b4bf46-93bd-4b11-bf01-00adabc19d75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.206930 Aug 22 16:27:15.640517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 974/1878] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:15 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:15.647180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:15.647832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:15.654170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:15.654660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:15.655096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:15.655848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:15.656296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:15.656721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:15.725135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:15.737907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-28712040-be0f-4e2f-897d-068960a4ee03 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094700 Aug 22 16:27:15.738910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 905/1879] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:15 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:16.641928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:16.642797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:16.649851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:16.650345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:16.650788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:16.651571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:16.652033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:16.652463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:16.664259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:16.665225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:16.673358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:16.674688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:16.675276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:16.676395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:16.677122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:16.677609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:16.749820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:16.758827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-415bc4fe-5cd1-4a7a-908d-58f0262a0099 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.121068 Aug 22 16:27:16.759815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 975/1880] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:16.770529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:16.771441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:16.778724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:16.780615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:16.781890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:16.782271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:16.783003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:16.783964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:16.863011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:16.872337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-67e51f2c-0b29-4006-be21-0098d6082bcf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.106246 Aug 22 16:27:16.873123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 976/1881] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:16 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:16.890366 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:16.905193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6e4cc8eb-811f-49ba-bff4-e9012737753b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.244686 Aug 22 16:27:16.906141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 906/1882] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:16 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:17.793308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:17.793871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:17.801401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:17.801937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:17.802407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:17.803174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:17.803698 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:17.804167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:17.872280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:17.881960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-69a9bfb7-8df6-442f-9d44-a02dcb8ead87 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.092937 Aug 22 16:27:17.882560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 977/1883] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:17.893537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:17.894196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:17.901098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:17.901578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:17.902016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:17.902718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:17.903173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:17.903629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:17.928873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:17.929640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:17.936780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:17.937644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:17.938454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:17.940423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:17.941272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:17.942022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:17.994078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:18.007087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7ff63fb0-f4bf-4f97-a7d0-f35a7eb82768 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.117033 Aug 22 16:27:18.008286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 907/1884] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:17 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:18.111112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:18.114807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:18.123044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-efbdf6a6-bce2-4bc0-87a8-b1ff3313ece4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.199255 Aug 22 16:27:18.123756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 978/1885] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:17 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:18.913238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:18.913943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:18.920761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:18.921245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:18.921679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:18.922379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:18.922827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:18.923240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:18.988135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:18.997303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-95107514-5ac9-486b-a574-4b27f41fd4f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087899 Aug 22 16:27:18.997909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 908/1886] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:19.030057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:19.030654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:19.037291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:19.037776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:19.038213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:19.038924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:19.039426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:19.039855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:19.107456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:19.116552 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3d0f411d-65f3-4070-9533-cef7191f14f6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090829 Aug 22 16:27:19.117142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 979/1887] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:19 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:19.144911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:19.145525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:19.152178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:19.152722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:19.153214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:19.153965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:19.154470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:19.155053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:19.318141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:19.327144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-87c086b9-4b40-40e9-af84-bd9c4581eca2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.186175 Aug 22 16:27:19.327789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 909/1888] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:19 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:20.018661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:20.019288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:20.025758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:20.026252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:20.026692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:20.027513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:20.027980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:20.028421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:20.092809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:20.101746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e517ddef-423c-45f6-ba8f-a4d2b81f28ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086970 Aug 22 16:27:20.102344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 980/1889] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:20.141703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:20.142654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:20.150617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:20.151107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:20.151589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:20.152304 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:20.152764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:20.153194 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:20.216392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:20.224963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f72f96b9-cc52-4553-8be6-2b60618f40c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087282 Aug 22 16:27:20.225527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 910/1890] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:20 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:20.359699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:20.360319 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:20.366947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:20.367471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:20.367910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:20.368615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:20.369111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:20.369563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:20.507053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:20.515466 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c57be85e-cb0b-443f-bfbd-cac4a09345fe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.159749 Aug 22 16:27:20.516039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 981/1891] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:20 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:21.122780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:21.123613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:21.131198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:21.131862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:21.132339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:21.133094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:21.133589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:21.134072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:21.203229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:21.214285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f30c4a29-2a13-4d7c-96fc-0db148cd2940 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.095682 Aug 22 16:27:21.214948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 911/1892] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:21.246440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:21.247186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:21.254871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:21.255404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:21.255844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:21.256558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:21.257015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:21.257440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:21.326306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:21.334622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3f08d65e-ff8a-4111-875a-8cfac015233c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092107 Aug 22 16:27:21.335217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 982/1893] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:21 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:21.537196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:21.537845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:21.545131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:21.545755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:21.546306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:21.547151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:21.547745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:21.548387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:21.693618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:21.708450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-96f992d5-d1ad-4647-b3f0-2107f264a0a3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.175265 Aug 22 16:27:21.709462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 912/1894] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:21 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:22.236126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:22.236750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:22.243018 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:22.243543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:22.243982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:22.244695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:22.245154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:22.245608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:22.311484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:22.321166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fa32a3c9-43bd-4ed2-bc7b-a20ea6e9bbe3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088914 Aug 22 16:27:22.321766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 983/1895] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:22.367479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:22.368109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:22.374912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:22.375403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:22.375849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:22.376568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:22.377027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:22.377461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:22.382122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:22.447923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:22.457361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-500d64bf-1eee-4016-b316-0b537f844cff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093786 Aug 22 16:27:22.458015 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 913/1896] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:22 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:22.731267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:22.732008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:22.738851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:22.739555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:22.739994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:22.740881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:22.741432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:22.741912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:22.902531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:22.911214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-92a1d312-793b-490e-b2da-81227a2de59f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.184218 Aug 22 16:27:22.911847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 984/1897] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:22 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:23.354550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:23.355154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:23.361970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:23.362449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:23.362877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:23.363606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:23.364050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:23.364468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:23.427657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:23.436518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8b379ba8-64a9-44f9-9573-3e1782fc45e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085769 Aug 22 16:27:23.437110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 914/1898] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:23.478742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:23.479582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:23.485906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:23.486990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:23.487444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:23.488133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:23.488580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:23.489000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:23.553550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:23.561626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-53559632-d249-417f-8932-e7b0008aa312 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086787 Aug 22 16:27:23.562203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 985/1899] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:23 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:23.933739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:23.934354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:23.941027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:23.941514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:23.941958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:23.942654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:23.943104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:23.943576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:24.074350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:24.083683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b6e08839-4007-42d1-b829-0230a04229d4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153799 Aug 22 16:27:24.084257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 915/1900] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:23 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:24.458307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:24.458956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:24.465388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:24.465870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:24.466306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:24.467015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:24.467505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:24.467927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:24.530852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:24.539407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eaf2169e-d434-473d-9bef-87f9cda343fc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085110 Aug 22 16:27:24.540343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 986/1901] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:24.582984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:24.583944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:24.590295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:24.590782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:24.591220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:24.591952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:24.592406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:24.592833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:24.655874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:24.663713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3668b14b-73a3-4edc-999e-de137049b3c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084602 Aug 22 16:27:24.664284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 916/1902] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:24 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:25.109464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:25.110070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:25.116079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:25.116556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:25.116989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:25.117677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:25.118126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:25.118543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:25.255558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:25.264284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f8155ded-e3fc-447e-ad6f-90c486772bd4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.158554 Aug 22 16:27:25.264851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 987/1903] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:25 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:25.561140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:25.561771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:25.569826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:25.570321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:25.570798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:25.571631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:25.572142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:25.572631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:25.642035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:25.652524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-127a5b27-f67b-4de7-9dfb-ec5e23c308b9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.095501 Aug 22 16:27:25.653107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 917/1904] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:25.684858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:25.685472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:25.692881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:25.693398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:25.693848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:25.694681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:25.695149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:25.695608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:25.764767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:25.774214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0dffc90b-b171-46e8-9d18-382b2be9ee2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093187 Aug 22 16:27:25.774813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 988/1905] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:25 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:26.287020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:26.287712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:26.294634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:26.295233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:26.295778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:26.296640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:26.297224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:26.297744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:26.448157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:26.458302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e0bb7b05-e42f-414c-a82a-c4d161acd9df tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.175955 Aug 22 16:27:26.458890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 918/1906] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:26 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:26.674055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:26.674668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:26.682872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:26.683393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:26.684033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:26.684966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:26.685541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:26.685984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:26.754808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:26.763364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a49de5d7-9fd4-4114-b3ab-50dbc8a63332 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093129 Aug 22 16:27:26.763965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 989/1907] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:26.797759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:26.798538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:26.808267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:26.808802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:26.809274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:26.810240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:26.810914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:26.811550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:26.888483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:26.897356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b3d566cd-cea8-46ee-b3a4-f858abf09ef4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.105885 Aug 22 16:27:26.897984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 919/1908] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:26 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:27.483821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:27.484436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:27.491410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:27.491904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:27.492357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:27.493053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:27.493544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:27.493999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:27.667250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:27.681641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bd59b96d-5fce-494b-81da-4f707e6404e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.201276 Aug 22 16:27:27.682365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 990/1909] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:27 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:27.786474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:27.787294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:27.789460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:27.796226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:27.796716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:27.797184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:27.798053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:27.799146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:27.799740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:27.865388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:27.878490 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cee6dcb7-0dec-42cd-8d44-cb2517a78e06 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.096486 Aug 22 16:27:27.879259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 920/1910] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:27.922007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:27.922667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:27.926304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=82 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:27.935081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:27.935645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:27.936157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:27.936919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:27.937435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:27.937882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:28.034248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:28.042924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b20fd6ef-c8bc-4b27-806f-3317820896f3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.126640 Aug 22 16:27:28.043478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 991/1911] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:27 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:28.709046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:28.709639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:28.715945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:28.716435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:28.716884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:28.717599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:28.718055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:28.718483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:28.860868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:28.870129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-aecb27f8-78c7-472f-9657-2aed39468adc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170547 Aug 22 16:27:28.870714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 921/1912] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:28 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:28.900801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:28.901415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:28.908050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:28.908531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:28.908968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:28.909671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:28.910426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:28.910554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:28.979643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:28.988335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9212645e-b157-4eb6-982a-356e09ec104d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091734 Aug 22 16:27:28.988918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 992/1913] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:29.065970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:29.067976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:29.074969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:29.075504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:29.075944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:29.076652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:29.077112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:29.077547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:29.143792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:29.151953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f75692a9-a2e4-41f4-a690-e9f3371a6598 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091410 Aug 22 16:27:29.152718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 922/1914] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:29 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:29.895056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:29.895815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:29.902231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:29.902724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:29.903164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:29.903930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:29.904474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:29.904923 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:30.010319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:30.011322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:30.019252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:30.019797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:30.020244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:30.020968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:30.021429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:30.021858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:30.057498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:30.071587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-83e16b39-0c2c-4f20-8dab-1f17d42b74c5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.181073 Aug 22 16:27:30.072169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 993/1915] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:29 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:30.092830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:30.101936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fbb849d2-d0c4-47d3-9fd8-24bcb2465fe8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.096061 Aug 22 16:27:30.102760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 923/1916] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:30.176618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:30.177649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:30.186415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:30.187236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:30.188010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:30.189738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:30.190535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:30.191267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:30.276868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:30.285078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-99d6ebd9-f208-4673-9d22-a7f80ba31210 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.114811 Aug 22 16:27:30.285644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 994/1917] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:30 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:31.093929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:31.094545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:31.101361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:31.101846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:31.102283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:31.102982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:31.103466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:31.103895 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:31.127468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:31.128119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:31.134819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:31.135306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:31.135963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:31.136741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:31.137256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:31.137701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:31.159745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:31.214557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:31.224609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f7df5752-a9c0-4774-b3a3-93d7cbe146f0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.102877 Aug 22 16:27:31.225610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 995/1918] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:31.280997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:31.291505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-06a7a2b3-cfe6-4b4e-bae3-0f65755d155f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.201229 Aug 22 16:27:31.292218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 924/1919] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:31 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:31.306862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:31.307640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:31.315027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:31.315543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:31.316040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:31.316842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:31.317306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:31.317792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:31.386030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:31.394366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f1b46e04-9907-42dd-9d10-3903bdb7407e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092132 Aug 22 16:27:31.394948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 996/1920] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:31 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:32.189631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:27:32.190444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:27:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:27:32.246904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:32.247546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:32.254908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:32.255430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:32.255870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:32.256577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:32.257032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:32.257456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:32.316289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:32.316917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:32.324263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:32.324755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:32.325196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:32.325910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:32.326363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:32.326810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:32.331268 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:32.340871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0e4be8af-351f-4b29-bd33-050deb73bc48 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.097792 Aug 22 16:27:32.341671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 925/1921] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:32.416815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:32.417768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:32.429667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:32.430055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:32.430838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:32.432050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:32.432858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:32.433749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:32.523833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:32.526966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:32.534546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eb87e317-1ffe-4e07-b1d2-ba93d4e978ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.122937 Aug 22 16:27:32.535628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 926/1922] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:32 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:32.540979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b187618-23e9-4c64-be1d-0aef46545de6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.229514 Aug 22 16:27:32.541748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 997/1923] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:32 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:33.179363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:27:33.179649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:27:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:27:33.364103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:33.364734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:33.371801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:33.372298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:33.372740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:33.373460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:33.373921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:33.374353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:33.445497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:33.454364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-18d1606f-09f1-4806-b8b8-f3f8657244c9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.095731 Aug 22 16:27:33.455064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 927/1924] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:33.556010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:33.556623 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:33.564524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:33.565134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:33.565317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:33.565587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:33.566113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:33.566383 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:33.566838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:33.567263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:33.573014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:33.573508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:33.573993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:33.574683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:33.575142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:33.575598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:33.648159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:33.656350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2ce44857-79a0-4173-a610-f304ce0d5562 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.104196 Aug 22 16:27:33.656950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 998/1925] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:33 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:33.752604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:33.767163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-26499538-c026-4f48-902a-682b983ae7a7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.206753 Aug 22 16:27:33.767163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 928/1926] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:33 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:34.477179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:34.477794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:34.484301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:34.484903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:34.485346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:34.486081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:34.486625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:34.487053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:34.524752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:27:34.525588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:27:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:27:34.552225 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:34.560766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0b388996-2ca7-42b2-8455-248aea55fda2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087753 Aug 22 16:27:34.561521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 999/1927] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:34.678254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:34.678879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:34.685834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:34.686323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:34.686779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:34.687503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:34.687973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:34.688396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:34.759230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:34.762708 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:34.768588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-16e7f5ec-eba6-4669-83be-8ba510de456f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094516 Aug 22 16:27:34.769162 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 929/1928] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:34 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:34.789957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:34.790652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:34.797719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:34.798808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:34.799231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:34.800103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:34.800592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:34.801005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:34.947786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:34.956386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-115c848f-00e5-407f-b87c-fd3d9dd12ef8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170588 Aug 22 16:27:34.957096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1000/1929] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:34 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:35.582916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:35.583561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:35.589676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:35.590161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:35.590631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:35.591478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:35.591860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:35.592288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:35.655803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:35.664344 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0b108261-b858-4366-97a4-37b4cc7c0177 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085388 Aug 22 16:27:35.664918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 930/1930] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:35.789848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:35.790500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:35.796800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:35.797286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:35.797731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:35.798977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:35.799462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:35.799891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:35.864592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:35.877722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bf9c92b9-e0c4-4939-a8b5-70a3256f15f7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091086 Aug 22 16:27:35.878366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1001/1931] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:35 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:35.978498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:35.979466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:35.990953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:35.991482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:35.991921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:35.992631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:35.993080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:35.993501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:36.143795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:36.152289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-768922de-3a7a-4989-a0af-3c142bb62a33 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.177705 Aug 22 16:27:36.152872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 931/1932] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:35 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:36.686386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:36.687058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:36.693994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:36.694491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:36.694930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:36.695684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:36.696141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:36.696570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:36.762362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:36.771982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b3289c4c-11fd-47eb-a7ec-59ab79937335 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089582 Aug 22 16:27:36.772561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1002/1933] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:36.899489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:36.900118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:36.906573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:36.907120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:36.907611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:36.908409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:36.909016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:36.909464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:36.983153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:36.991934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b641ea5a-3f00-4f77-b22a-7b0566a45655 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.096297 Aug 22 16:27:36.992482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 932/1934] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:36 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:37.173693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:37.174318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:37.181459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:37.181962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:37.182412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:37.183179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:37.183691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:37.184139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:37.336259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:37.345162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6d125ee2-1279-45f3-8f0d-e6c313a528d9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.175942 Aug 22 16:27:37.345761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1003/1935] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:37 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:37.793010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:37.793535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:37.800044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:37.800520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:37.800953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:37.801651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:37.802098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:37.802524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:37.864548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:37.873066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0dd2373b-277d-4492-bb04-0ee856881564 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083953 Aug 22 16:27:37.873634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 933/1936] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:38.013696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:38.014404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:38.021041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:38.021526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:38.021963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:38.022663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:38.023117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:38.023588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:38.087094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:38.102695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f9e777ea-04ad-4e91-aa21-bdc5621af500 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093260 Aug 22 16:27:38.103277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1004/1937] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:38 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:38.366973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:38.367669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:38.374354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:38.374837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:38.375270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:38.375993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:38.376977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:38.377398 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:38.526971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:38.535746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-face8763-c4ed-4864-b18b-7c8a9378cb17 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.172705 Aug 22 16:27:38.536331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 934/1938] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:38 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:38.894314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:38.894977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:38.901657 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:38.902142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:38.902578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:38.903284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:38.903761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:38.904188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:38.971701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:38.980448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5e23ee2f-74f2-4c8f-98e0-123b29460b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.090551 Aug 22 16:27:38.981045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1005/1939] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:39.124153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:39.124771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:39.131412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:39.131899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:39.132339 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:39.133043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:39.133498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:39.133926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:39.199670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:39.207616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cecc5910-6121-444e-ba92-c525fc2c4d51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087579 Aug 22 16:27:39.208206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 935/1940] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:39 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:39.557832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:39.558446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:39.564809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:39.565303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:39.565741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:39.566478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:39.566941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:39.567395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:39.710172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:39.718933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-521ff974-7bcc-4494-a441-22d54c87b5ef tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.164852 Aug 22 16:27:39.719534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1006/1941] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:39 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:40.002999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:40.003664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:40.011674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:40.012166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:40.012615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:40.013334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:40.013790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:40.014221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:40.080547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:40.089355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3131cf6c-00eb-4d9d-926b-12c4a6036384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091621 Aug 22 16:27:40.089930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 936/1942] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:40.230568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:40.231181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:40.238537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:40.239022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:40.239485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:40.240186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:40.240636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:40.241052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:40.304311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:40.312840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eeba84b5-0b2e-4eeb-b1cd-6c9e0cfec902 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086380 Aug 22 16:27:40.313423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1007/1943] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:40 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:40.741920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:40.742537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:40.748592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:40.749089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:40.749561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:40.750210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:40.750659 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:40.751084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:40.885735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:40.894881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a892c373-3d74-44fb-af3b-6ee09a80b447 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.157028 Aug 22 16:27:40.895517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 937/1944] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:40 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:41.110063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:41.110670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:41.116841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:41.117413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:41.117849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:41.118625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:41.119098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:41.119602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:41.182742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:41.191777 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bfbedc97-4f19-40ec-a033-8560426d6da3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085477 Aug 22 16:27:41.192352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1008/1945] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:41.335276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:41.336045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:41.342451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:41.342925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:41.343386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:41.344084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:41.344532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:41.344973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:41.419458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:41.428206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a9c552f9-ee18-41d7-80e9-3bcdbbf03018 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.096807 Aug 22 16:27:41.428803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 938/1946] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:41 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:41.917692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:41.918349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:41.925886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:41.926381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:41.926818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:41.927581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:41.928041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:41.928466 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:42.063544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:42.072222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e2a9f714-db40-44ef-9c6d-a6ecf14f455d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.158429 Aug 22 16:27:42.073043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1009/1947] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:41 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:42.215008 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:42.215566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:42.222103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:42.222580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:42.223373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:42.224026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:42.224470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:42.224996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:42.290144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:42.299108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ee222cf6-afae-402c-9fdc-33978273cb2a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087505 Aug 22 16:27:42.299713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 939/1948] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:42.457842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:42.458464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:42.465188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:42.465570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:42.466012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:42.466720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:42.467212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:42.467662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:42.549762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:42.558143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-07e31d82-8121-41bd-922e-e0fbe883f808 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.105581 Aug 22 16:27:42.558728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1010/1949] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:42 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:43.093678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:43.094285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:43.101313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:43.101794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:43.102227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:43.102935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:43.103423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:43.103846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:43.240887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:43.249682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b15d817b-48a6-4555-9553-d42a30b43106 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.160146 Aug 22 16:27:43.250266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 940/1950] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:43 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:43.321080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:43.321708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:43.328433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:43.328932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:43.329464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:43.330189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:43.330651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:43.331077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:43.396373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:43.405610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-87f6b11a-bafc-4559-9061-7024bd9bd328 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088477 Aug 22 16:27:43.406209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1011/1951] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:43.579034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:43.579614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:43.586028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:43.586526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:43.586973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:43.587755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:43.588229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:43.588662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:43.658800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:43.666705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-97c2817b-aa43-47bb-b9d1-9322ec49e647 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091678 Aug 22 16:27:43.667314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 941/1952] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:43 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:44.271945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:44.272736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:44.279281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:44.279808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:44.280251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:44.280971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:44.281431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:44.281861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:44.286241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:44.428766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:44.429740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:44.430799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:44.441517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:44.442317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:44.443049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:44.444232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:44.444974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:44.445261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2460efde-7f1e-4478-8f5e-5393074b0b47 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.176723 Aug 22 16:27:44.445697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:44.446243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1012/1953] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:44 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:44.511103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:44.520260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b16f3061-749d-4bb9-b154-c1f4b57aa6a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.097172 Aug 22 16:27:44.520828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 942/1954] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:44.687920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:44.689178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:44.695192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:44.695716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:44.696139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:44.696832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:44.697279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:44.697706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:44.762288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:44.770110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ef024f35-6437-45b4-94a3-65add175f695 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086041 Aug 22 16:27:44.770671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1013/1955] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:44 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:45.470416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:45.471207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:45.478789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:45.479271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:45.479809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:45.480517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:45.480971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:45.481392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:45.545135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:45.546370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:45.557343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:45.558189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:45.558976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:45.560270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:45.561062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:45.562352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:45.638687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:45.648396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e1175372-6305-4526-81e0-15a8f37672c4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.182587 Aug 22 16:27:45.648991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 943/1956] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:45 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:45.658452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:45.674262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d36eee99-76df-4633-92df-6ea88e40d88f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.136493 Aug 22 16:27:45.674955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1014/1957] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:45.790757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:45.791278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:45.797375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:45.797844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:45.798273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:45.798962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:45.799446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:45.799871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:45.867533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:45.876607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dc117b65-8816-4b7d-8ce6-62c9565357e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089203 Aug 22 16:27:45.877202 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 944/1958] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:45 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:46.682134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:46.682772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:46.689862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:46.690540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:46.691078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:46.691902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:46.692589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:46.693091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:46.697714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:46.698329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:46.705031 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:46.705530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:46.705973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:46.706728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:46.707183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:46.707648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:46.800235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:46.809183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-85661995-347e-42fd-a1bd-91d7b17af8ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.115476 Aug 22 16:27:46.809762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 945/1959] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:46.874845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:46.883722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af593510-5988-4138-b41e-45a4cf1722f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.205667 Aug 22 16:27:46.884310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1015/1960] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:46 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:46.898124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:46.898747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:46.905210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:46.905697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:46.906134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:46.906844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:46.907847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:46.908328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:46.927545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:46.973875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:46.981955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8e1a0d8f-29db-4fe0-bd7f-773f91dbbff0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087857 Aug 22 16:27:46.982524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 946/1961] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:46 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:47.831557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:47.832257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:47.838969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:47.839498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:47.839939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:47.840654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:47.841114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:47.841551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:47.907783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:47.907783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:47.910364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:47.914521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:47.915016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:47.915494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:47.916215 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:47.916674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:47.917104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:47.920471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ef5b3452-d050-49f5-8746-cbe77e93dfed tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.092651 Aug 22 16:27:47.921127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1016/1962] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:48.003365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:48.004130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:48.013769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:48.014609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:48.015162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:48.015981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:48.016597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:48.017104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:48.078476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:48.092573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b45509cc-a474-412a-a0c4-14613c118ac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.189417 Aug 22 16:27:48.095777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 947/1963] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:47 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:48.097391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:48.106195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5035e530-7c54-48df-81e3-645574c4f6c4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.107123 Aug 22 16:27:48.107018 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1017/1964] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:47 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:48.944112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:48.944858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:48.951862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:48.952351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:48.952791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:48.953511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:48.953963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:48.954927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:49.021190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:49.030634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fc008dd1-2807-4f65-8333-9f0f29f94e24 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.090478 Aug 22 16:27:49.031461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 948/1965] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:49.128680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:49.129327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:49.131697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:49.132849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:49.136262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:49.136969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:49.137473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:49.138242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:49.138819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:49.139406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:49.144158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:49.145024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:49.145769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:49.147003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:49.147797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:49.148559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:49.245537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:49.254935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0e84bbd4-d69c-4aba-9ebe-00501a9e1a1b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.131180 Aug 22 16:27:49.255559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1018/1966] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:49 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:49.329991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:49.338484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b4ad05d5-ed0a-49c9-99f9-03cce1f86c84 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.214485 Aug 22 16:27:49.339156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 949/1967] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:49 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:50.052768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:50.053387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:50.059584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:50.060071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:50.060507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:50.061205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:50.061659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:50.062081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:50.127246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:50.135847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-395b93c1-d18d-4b8c-9f7e-9df5112add70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087193 Aug 22 16:27:50.136624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1019/1968] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:50.276547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:50.277605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:50.284668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:50.285152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:50.285585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:50.286293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:50.286745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:50.287163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:50.354391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:50.360926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:50.361693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:50.363200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f2fa4502-a672-44e4-bc70-a5eab154dd71 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090721 Aug 22 16:27:50.364353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 950/1969] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:50 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:50.369631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:50.370195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:50.370689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:50.371645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:50.372165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:50.372654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:50.539211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:50.550188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bd3fe561-290d-4112-8a1e-394fd7940475 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.193768 Aug 22 16:27:50.550822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1020/1970] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:50 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:51.157333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:51.157946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:51.164297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:51.164781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:51.165216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:51.165931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:51.166386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:51.166880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:51.242719 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:51.251813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b13d6d2c-fd57-4031-9a3c-d8ac3a4e05ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.098378 Aug 22 16:27:51.252388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 951/1971] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:51.387310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:51.388289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:51.394852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:51.395368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:51.395891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:51.396604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:51.397056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:51.397479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:51.470464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:51.479966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-46225c64-8392-4118-85ed-d37d8ad0a7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.096731 Aug 22 16:27:51.480658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1021/1972] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:51 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:51.572072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:51.572725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:51.579264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:51.579785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:51.580216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:51.580913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:51.581362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:51.581783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:51.955450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:51.964185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c71f896e-bee9-4c6b-96dc-bafcf99a5a5b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.396012 Aug 22 16:27:51.964749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 952/1973] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:51 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:52.273723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:52.274345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:52.280638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:52.281115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:52.281547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:52.282795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:52.283250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:52.283695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:52.346804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:52.355427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3b78df2d-6475-4b19-9514-6a74a936b029 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085833 Aug 22 16:27:52.355995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1022/1974] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:52.502477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:52.503085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:52.510176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:52.510766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:52.511093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:52.511843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:52.512293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:52.512718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:52.582531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:52.590957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cda36c1f-deb6-4b8c-bf11-09373ec09faa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092932 Aug 22 16:27:52.591583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 953/1975] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:52 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:52.999760 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:53.000419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:53.007735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:53.008221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:53.008658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:53.009376 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:53.009919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:53.010246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:53.150570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:53.158896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-828c03ef-9ea8-4c74-8179-88191f390632 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.163295 Aug 22 16:27:53.159500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1023/1976] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:52 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:53.376943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:53.377706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:53.383981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:53.384442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:53.384865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:53.385552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:53.386002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:53.386417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:53.449316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:53.457947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ce61dc54-3d50-4330-a876-3ecd0a7f392c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085027 Aug 22 16:27:53.458528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 954/1977] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:53.612724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:53.613336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:53.619919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:53.620404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:53.620843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:53.621579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:53.622034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:53.622455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:53.692401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:53.701869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ea478cf1-e55b-4c34-bb29-e454e62b602a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093098 Aug 22 16:27:53.702474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1024/1978] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:53 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:54.198184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:54.198873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:54.206336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:54.206827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:54.207255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:54.208011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:54.208454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:54.208883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:54.352890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:54.361370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-423c1888-7bdc-4bd1-8522-be92638400c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170702 Aug 22 16:27:54.361948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 955/1979] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:54 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:54.479717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:54.480285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:54.486780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:54.487261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:54.487729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:54.488428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:54.488885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:54.489309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:54.552045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:54.560267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2d2c913d-22d7-4f61-827e-f641459ba26e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084571 Aug 22 16:27:54.560838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1025/1980] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:54.724169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:54.724773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:54.730925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:54.731394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:54.731823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:54.732509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:54.732956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:54.733377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:54.793956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:54.801701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c6df55bd-e932-4cce-a265-a25f04427583 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081647 Aug 22 16:27:54.802267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 956/1981] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:54 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:55.384026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:55.384661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:55.390691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:55.391172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:55.391642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:55.392337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:55.392797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:55.393231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:55.524287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:55.533053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-27a9aa4d-d2e4-4073-9531-1848d7eb8be0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152960 Aug 22 16:27:55.533646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1026/1982] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:55 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:55.581434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:55.582161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:55.588613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:55.589102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:55.589537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:55.590227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:55.590677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:55.591102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:55.651722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:55.660477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8257d1d6-5f38-44d2-ad61-be954c57577b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082940 Aug 22 16:27:55.661047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 957/1983] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:55.822122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:55.822741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:55.829274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:55.829757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:55.830195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:55.830888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:55.831366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:55.831807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:55.893155 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:55.901124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-999f495e-a93a-4419-966f-4fa56b0fc030 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082765 Aug 22 16:27:55.901628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1027/1984] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:55 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:56.556106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:56.556716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:56.562776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:56.563904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:56.564338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:56.565034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:56.565486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:56.565903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:56.682084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:56.682739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:56.689767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:56.690251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:56.690691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:56.691423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:56.691880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:56.692311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:56.698346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:56.706780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eea77f73-30d4-4f4b-89d4-0c6883718b46 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155771 Aug 22 16:27:56.707684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 958/1985] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:56 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:56.754616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:56.758112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:56.763572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-730b36a0-7ff7-4269-974b-0b845ca04181 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085424 Aug 22 16:27:56.764132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1028/1986] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:56.922114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:56.923232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:56.929241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:56.929748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:56.930168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:56.930863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:56.931311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:56.931761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:56.998083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:57.006771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9cb7da8c-a661-49af-a48a-b023e97e3a3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088465 Aug 22 16:27:57.008675 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 959/1987] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:56 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:57.728951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:57.729596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:57.735851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:57.736332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:57.736773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:57.737484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:57.737943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:57.738367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:57.784598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:57.785226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:57.792214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:57.792700 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:57.793146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:57.793859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:57.794336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:57.794748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:57.869150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:57.878073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8de1f24b-1fd9-4348-b2f4-79185c6c9461 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.097411 Aug 22 16:27:57.878648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 960/1988] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:57.897965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:57.906196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-461635db-b276-44de-90a0-e4aad77031ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.181548 Aug 22 16:27:57.906765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1029/1989] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:57 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:58.029295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:58.029920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:58.031860 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=82 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:58.037316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:58.037800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:58.038239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:58.038977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:58.039462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:58.039894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:58.101927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:58.109634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6a4f4a5f-facb-48cb-8fd0-2b5b82e44346 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084242 Aug 22 16:27:58.110779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 961/1990] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:58 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:58.898390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:58.898997 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:58.901326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=78 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:27:58.906684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:58.907812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:58.908245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:58.908932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:58.909379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:58.909796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:58.927307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:58.928049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:58.934446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:58.934935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:58.935399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:58.936105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:58.936561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:58.936990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:58.971130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:58.979784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-81389471-ab6c-471e-9d7d-5a72e86c9b58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085172 Aug 22 16:27:58.980374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1030/1991] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:27:59.070950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:59.079916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f62bbf8d-e5a7-496d-a32d-0a0da50a563f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.156939 Aug 22 16:27:59.080491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 962/1992] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:58 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:27:59.129981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:27:59.130583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:27:59.136598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:59.137077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:59.137588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:59.138291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:27:59.138738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:27:59.139158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:27:59.205534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:27:59.215109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6d8dd703-59ae-48fa-ad3a-a2d6cea748ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088937 Aug 22 16:27:59.215711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1031/1993] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:59 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:00.001500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:00.002156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:00.008499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:00.008967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:00.009389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:00.010072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:00.010514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:00.010931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:00.014888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:00.072065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:00.080230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-865460e5-00f1-4fa2-92f3-21277d148f17 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082592 Aug 22 16:28:00.080788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 963/1994] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:27:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:00.101571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:00.102196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:00.108688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:00.109173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:00.109610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:00.110987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:00.111476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:00.111908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:00.236972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:00.237616 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:00.243682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:00.243943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:00.244429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:00.245505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:00.246221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:00.246669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:00.247090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:00.252617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8202ba14-cf7a-406f-a946-09d1ccc65eb2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155000 Aug 22 16:28:00.253221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1032/1995] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:00 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:00.308507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:00.316295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0768edbb-7c13-4735-bf20-e4e948e1b180 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083942 Aug 22 16:28:00.316857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 964/1996] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:00 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:01.101323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:01.101932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:01.108194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:01.108668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:01.109100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:01.110301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:01.110753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:01.111171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:01.174162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:01.182534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a11db239-13cb-45e2-9191-d26ff6115af4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085250 Aug 22 16:28:01.183117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1033/1997] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:01.273910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:01.274553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:01.281276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:01.281771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:01.282221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:01.282922 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:01.283407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:01.283846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:01.337670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:01.338293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:01.344454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:01.344940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:01.345372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:01.346078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:01.346528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:01.346950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:01.423074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:01.430889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-62bbde3c-a1ac-416c-ba69-f2077f2c1527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.097142 Aug 22 16:28:01.431706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1034/1998] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:01 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:01.447540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:01.456315 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7ddc6178-1072-40e7-92ca-62b2165a21cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.186357 Aug 22 16:28:01.456888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 965/1999] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:01 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:02.204726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:02.205439 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:02.211891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:02.212367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:02.212795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:02.213484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:02.213931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:02.214348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:02.276157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:02.284746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1f8e0ca6-571f-4391-83d8-ca4a750f9726 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084510 Aug 22 16:28:02.285338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1035/2000] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:02.452194 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:02.452813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:02.459824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:02.460241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:02.460667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:02.461366 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:02.461798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:02.462219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:02.477621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:02.478339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:02.486736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:02.487540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:02.488246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:02.489377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:02.490087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:02.490783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:02.535842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:02.544306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1abf5e84-d70e-4a7f-897c-69b3d3abb909 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095856 Aug 22 16:28:02.544889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 966/2001] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:02 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:02.635010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:02.643239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c15d0526-0a43-4573-a21b-3140d5c68dc7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.169868 Aug 22 16:28:02.643849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1036/2002] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:02 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:03.306078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:03.306714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:03.312609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:03.313084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:03.313513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:03.314194 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:03.314637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:03.315054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:03.377000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:03.385158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6f94af3c-c5cc-43d1-9b59-7aa825805594 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083151 Aug 22 16:28:03.385723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 967/2003] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:03.564504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:03.565116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:03.571997 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:03.572481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:03.572909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:03.573603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:03.574054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:03.574472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:03.636853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:03.645109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0bdc3343-47e7-4cd1-9a4b-9f34306364ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084456 Aug 22 16:28:03.645672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1037/2004] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:03 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:03.664110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:03.664726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:03.671199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:03.671718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:03.672155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:03.672858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:03.673308 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:03.673730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:03.809863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:03.820157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9a8e68a4-bd59-4338-a54f-db2b18c79045 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.159714 Aug 22 16:28:03.820918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 968/2005] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:03 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:04.409407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:04.410023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:04.416127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:04.416608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:04.417047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:04.417748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:04.418205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:04.418633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:04.479983 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:04.488596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8c39dac4-0558-4b6a-a6b5-27c0330e15b0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083612 Aug 22 16:28:04.489186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1038/2006] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:04.666285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:04.666861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:04.673594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:04.674083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:04.674526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:04.675233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:04.675729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:04.676159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:04.738300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:04.749310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cd958dc6-5897-4649-9707-b32c84b79f8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086622 Aug 22 16:28:04.751007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 969/2007] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:04 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:04.842604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:04.843200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:04.850542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:04.851023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:04.851489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:04.852190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:04.852631 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:04.853051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:04.987223 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:04.996002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-979f3205-7def-44c8-9954-2d61d04c2430 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.157234 Aug 22 16:28:04.996586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1039/2008] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:04 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:05.511964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:05.512573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:05.520168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:05.520647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:05.521077 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:05.521799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:05.522251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:05.522671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:05.586294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:05.594973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ff5bd8be-d304-42d8-b17f-29f70d457511 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088609 Aug 22 16:28:05.595593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 970/2009] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:05.770524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:05.771054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:05.777324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:05.777791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:05.778218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:05.778901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:05.779361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:05.779784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:05.841192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:05.849546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d312e7a1-e65e-4bff-bf6b-640949bcb711 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083039 Aug 22 16:28:05.850166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1040/2010] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:05 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:06.017600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:06.018225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:06.025117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:06.025579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:06.026144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:06.026971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:06.027543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:06.028166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:06.171750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:06.180996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-91cd8b53-1aef-48a0-81f7-beb6696baed5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.167248 Aug 22 16:28:06.181621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 971/2011] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:06 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:06.616406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:06.617024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:06.623446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:06.623942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:06.624367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:06.625145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:06.625512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:06.625938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:06.697617 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:06.706639 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b24835b-a27b-4aa3-aafe-ec6d990600ea tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.094160 Aug 22 16:28:06.707221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1041/2012] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:06.870184 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:06.870804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:06.877372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:06.877858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:06.878296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:06.878993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:06.879482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:06.879914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:06.941693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:06.949710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6e0a3850-d342-4573-830c-ae216b626538 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083327 Aug 22 16:28:06.950209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 972/2013] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:06 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:07.202810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:07.203404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:07.210235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:07.210730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:07.211164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:07.211909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:07.212363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:07.212784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:07.353830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:07.363097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5d964030-a6a5-41e5-bb3f-0ce9218400ed tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.164194 Aug 22 16:28:07.363676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1042/2014] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:07 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:07.727836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:07.728588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:07.735960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:07.736459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:07.736901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:07.737633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:07.738085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:07.738514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:07.806146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:07.815510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f053b6bf-4770-424d-aff9-90c0ca697ed2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091727 Aug 22 16:28:07.816122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 973/2015] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:07.971485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:07.972110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:07.978754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:07.979274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:07.979747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:07.980479 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:07.980918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:07.981341 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:08.045818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:08.054236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2160d2cf-adab-4484-9c42-5ed3ee83b742 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087152 Aug 22 16:28:08.054827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1043/2016] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:07 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:08.385821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:08.386612 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:08.393455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:08.393944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:08.394389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:08.395094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:08.395583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:08.396014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:08.535968 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:08.545959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b2e83f45-3620-4a4e-8021-4add3f58daf8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.163982 Aug 22 16:28:08.546697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 974/2017] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:08 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:08.836333 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:08.836966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:08.843648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:08.844132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:08.844567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:08.845276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:08.845732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:08.846162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:08.912845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:08.921636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5203b409-a60c-4ac9-a0e0-43d1b0549c52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089128 Aug 22 16:28:08.923229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1044/2018] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:09.075894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:09.076662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:09.083583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:09.084104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:09.084544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:09.085298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:09.085734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:09.086157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:09.154124 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:09.162446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bffb26ab-9bc1-41ee-8464-ce3e1ff4dacc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090688 Aug 22 16:28:09.163010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 975/2019] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:09 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:09.568766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:09.569375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:09.575577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:09.576055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:09.576486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:09.577182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:09.577630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:09.578056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:09.598863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:09.715724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:09.724644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e2634290-7d5c-448c-867b-1267e05422b2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.159924 Aug 22 16:28:09.725220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1045/2020] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:09 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:09.944691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:09.945306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:09.951500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:09.951971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:09.952417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:09.953130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:09.954203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:09.954635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:10.028322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:10.043248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d54a0215-8dd5-48c5-bc97-7acf2414e9b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.102344 Aug 22 16:28:10.044302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 976/2021] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:10.196242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:10.197067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:10.203529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:10.204044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:10.204490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:10.205194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:10.205653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:10.206097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:10.274107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:10.282610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-860c5da7-a61c-424d-82aa-70e625b9ccb6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090263 Aug 22 16:28:10.283196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1046/2022] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:10 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:10.746121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:10.746766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:10.753826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:10.754368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:10.754807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:10.755573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:10.756035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:10.756466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:10.902356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:10.911672 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c0a23933-89c5-42f5-b86b-3313bfe3494a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.169384 Aug 22 16:28:10.912261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 977/2023] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:10 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:11.066015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:11.066637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:11.072798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:11.073287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:11.073726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:11.074432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:11.074889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:11.075315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:11.139355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:11.148729 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8b95529b-99f9-40a2-84f0-cfb8e6813cf8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086823 Aug 22 16:28:11.149315 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1047/2024] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:11.321818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:11.322839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:11.333603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:11.334380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:11.335048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:11.336270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:11.336981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:11.337669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:11.441292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:11.455879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f4818d45-131e-41bb-b4b1-28c2f1abd115 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.140296 Aug 22 16:28:11.456793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 978/2025] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:11 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:11.933174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:11.934024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:11.942430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:11.942922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:11.943534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:11.944136 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:11.944597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:11.945027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:12.087142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:12.095613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cb474b13-c731-422d-9819-5d33ef00cc51 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.166347 Aug 22 16:28:12.096196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1048/2026] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:11 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:12.183463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:12.184071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:12.191443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:12.191987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:12.192469 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:12.193225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:12.193778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:12.194248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:12.263041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:12.267734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:12.274141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-29527fc4-5982-4a2d-8639-beb39090b220 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.094558 Aug 22 16:28:12.274754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 979/2027] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:12.477458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:12.478176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:12.485943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:12.486490 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:12.486979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:12.487877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:12.488398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:12.488881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:12.566785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:12.575147 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-722bc5d6-1b0d-43b5-b516-9533744275af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.101955 Aug 22 16:28:12.575779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1049/2028] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:12 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:13.118857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:13.119544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:13.125686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:13.126175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:13.126614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:13.127348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:13.127802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:13.128230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:13.260189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:13.269101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d056413f-0126-445f-a2a9-7a932781601b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154332 Aug 22 16:28:13.269663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 980/2029] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:13 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:13.295658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:13.296279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:13.302661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:13.303150 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:13.303629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:13.304358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:13.304849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:13.305280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:13.368246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:13.376666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5cbc03ab-dd3f-460e-94a9-d3015fe113db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085031 Aug 22 16:28:13.377169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1050/2030] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:13.595161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:13.595910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:13.602253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:13.602745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:13.603185 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:13.603915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:13.604372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:13.604799 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:13.666534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:13.674461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e3808e23-b207-440f-ac9f-3026bfbdd7ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083254 Aug 22 16:28:13.675027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 981/2031] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:13 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:14.290810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:14.291455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:14.297667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:14.298353 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:14.298584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:14.299295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:14.299778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:14.300204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:14.397691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:14.398427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:14.406450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:14.407217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:14.407898 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:14.409196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:14.409818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:14.410262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:14.439106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:14.447407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5d9a9305-9498-4afc-8fbd-cb21c08d0ca4 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.160462 Aug 22 16:28:14.448425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1051/2032] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:14 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:14.472656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:14.481138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-51ac08c2-2a9d-4160-8dc5-1b23c72be4ef tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087317 Aug 22 16:28:14.481706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 982/2033] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:14.694995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:14.695636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:14.702723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:14.703208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:14.703681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:14.704378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:14.704833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:14.705260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:14.766652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:14.774541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-76ff4e9a-463f-451e-bfb5-19ed2182be6f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083468 Aug 22 16:28:14.775106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1052/2034] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:14 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:15.470037 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:15.470658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:15.477296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:15.477772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:15.478200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:15.478884 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:15.479362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:15.479786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:15.501885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:15.502695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:15.509787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:15.510271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:15.510705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:15.511459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:15.511912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:15.512334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:15.579570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:15.588023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0d5a40e5-6a71-4039-b750-d4da18ff11e7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.090026 Aug 22 16:28:15.588587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1053/2035] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:15 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:15.633937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:15.642553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-be16884b-860a-46c6-85c6-d95230203a72 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.177050 Aug 22 16:28:15.643119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 983/2036] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:15 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:15.795381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:15.795913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:15.802162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:15.802641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:15.803071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:15.803815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:15.804244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:15.804661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:15.865653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:15.873435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cfccef71-b806-4966-b0e3-549ff8031ac4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082052 Aug 22 16:28:15.874002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1054/2037] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:15 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:16.609673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:16.610311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:16.616932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:16.617409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:16.617926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:16.618623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:16.619071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:16.619527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:16.663464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:16.664002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:16.670688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:16.671162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:16.671624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:16.672308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:16.672754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:16.673169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:16.683557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:16.692534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-815585e7-c091-4fa0-ba7c-3f7f9f49814b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086720 Aug 22 16:28:16.693104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 984/2038] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:16.803321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:16.811772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7215103a-5df8-4528-98b3-8b2cead293ec tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152178 Aug 22 16:28:16.812342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1055/2039] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:16 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:16.896273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:16.896930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:16.902907 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:16.903436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:16.903878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:16.904609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:16.905066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:16.905496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:16.965651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:16.973788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fe6aec28-d8d1-49cd-afa1-015a5803009b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081117 Aug 22 16:28:16.974351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 985/2040] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:16 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:17.714289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:17.714922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:17.722272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:17.722755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:17.723470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:17.724187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:17.724640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:17.725063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:17.787590 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:17.795929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ec3e757b-3b2f-422f-86df-c2edbd7e38ac tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085515 Aug 22 16:28:17.796428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1056/2041] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:17.834088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:17.834787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:17.841410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:17.842530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:17.842977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:17.844403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:17.844864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:17.845301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:17.983232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:17.991802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3b3c8239-4bf1-49df-aa87-6d57ff91f99e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161587 Aug 22 16:28:17.992377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 986/2042] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:17 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:17.994020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:17.994633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:18.001385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:18.001877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:18.002314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:18.003050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:18.003544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:18.003972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:18.065976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:18.073827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bc38241b-634c-46ce-ab34-1fed05a959b3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083645 Aug 22 16:28:18.074400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1057/2043] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:17 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:18.820773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:18.821904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:18.833203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:18.834043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:18.834803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:18.836063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:18.836887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:18.837566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:18.923966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:18.932818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e781e63e-14a9-402f-91a2-69cf314bb2e1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.119341 Aug 22 16:28:18.933400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 987/2044] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:19.013327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:19.013996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:19.021161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:19.021652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:19.022121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:19.022971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:19.023404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:19.023766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:19.095371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:19.096114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:19.103511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:19.104128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:19.104748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:19.105643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:19.106203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:19.106758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:19.168813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:19.179482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ae58a87b-3082-4573-b0b5-5599de408b2f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.169953 Aug 22 16:28:19.180531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1058/2045] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:19 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:19.203562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:19.213597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-061ebc61-dd21-4b0f-af7e-82d9e649d3a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.122571 Aug 22 16:28:19.214209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 988/2046] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:19 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:19.954753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:19.955527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:19.962456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:19.963038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:19.963580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:19.964359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:19.964910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:19.965387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:20.030976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:20.040074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7c72cc5e-4a2a-48ca-8f1c-2f583db59a12 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089681 Aug 22 16:28:20.040653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1059/2047] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:20.214715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:20.215682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:20.222415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:20.222903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:20.223640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:20.224357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:20.224812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:20.225241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:20.237827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:20.238951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:20.249039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:20.250389 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:20.251174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:20.252429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:20.253216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:20.253947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:20.354806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:20.368299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-32443cba-9e9f-405b-87a4-f3e74bf47823 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.137202 Aug 22 16:28:20.369279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1060/2048] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:20 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:20.392936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:20.402467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9b99044a-0d45-47bf-b488-f3ab9221e315 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.191801 Aug 22 16:28:20.403108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 989/2049] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:20 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:21.073561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:21.074194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:21.081751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:21.082248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:21.082683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:21.083427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:21.083888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:21.084323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:21.149651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:21.158775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8475fc73-8d7c-4c9c-9ff2-876fc0e35ded tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089061 Aug 22 16:28:21.159425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1061/2050] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:21.407039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:21.408137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:21.418107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:21.421095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:21.421095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:21.421095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:21.421095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:21.421816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:21.429806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:21.430773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:21.441296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:21.442224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:21.443252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:21.445021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:21.445813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:21.446805 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:21.455590 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:21.530525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:21.541508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cf99b44c-3f30-43e5-aec5-d05add7524e6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.141933 Aug 22 16:28:21.542501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 990/2051] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:21 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:21.673545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:21.686299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b018bed4-b65c-4091-a97a-b55336bfc882 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.262679 Aug 22 16:28:21.688104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1062/2052] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:21 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:22.180787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:22.181425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:22.187928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:22.188426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:22.188869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:22.189592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:22.190051 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:22.190480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:22.258735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:22.268825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4f688a03-1efe-4eba-9557-c14cf5b16fdc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.092042 Aug 22 16:28:22.269419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 991/2053] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:22.575610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:22.576255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:22.583613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:22.584096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:22.584523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:22.585207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:22.585656 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:22.586099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:22.662173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:22.670881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9ea869c2-9d7d-425f-bd75-e485da620acf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.099133 Aug 22 16:28:22.671541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1063/2054] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:22 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:22.709763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:22.710444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:22.717213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:22.717696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:22.718142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:22.718850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:22.719298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:22.719739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:22.862609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:22.871108 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-92926aca-e7e5-441a-ab99-161028ebac19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.165398 Aug 22 16:28:22.871747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 992/2055] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:22 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:23.306654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:23.307837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:23.318202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:23.319051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:23.319889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:23.321100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:23.321930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:23.322700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:23.389220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:23.397695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-11c0b2c2-e622-4dde-9bf7-fb8baab3e281 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.098188 Aug 22 16:28:23.398278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1064/2056] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:23.691006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:23.691644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:23.697983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:23.698473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:23.698912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:23.699663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:23.700121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:23.700561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:23.766619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:23.774809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c9426673-715e-4539-90d6-8772478daac5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087859 Aug 22 16:28:23.775480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 993/2057] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:23 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:23.894201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:23.895135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:23.901761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:23.902249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:23.902687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:23.903428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:23.903879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:23.904306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:24.045779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:24.059035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7025df4b-a056-4666-b2dd-19ea6c1f6d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.169192 Aug 22 16:28:24.060099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1065/2058] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:23 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:24.432466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:24.433283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:24.439582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:24.440119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:24.440594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:24.441354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:24.441851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:24.442318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:24.508198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:24.517819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c2eec0cc-5b89-4b0e-bc71-3dd618f3a665 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089535 Aug 22 16:28:24.518418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 994/2059] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:24.796811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:24.797339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:24.804144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:24.804643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:24.805082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:24.805813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:24.806272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:24.806702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:24.874482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:24.884361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-582a1883-5414-47ed-992e-b4f712eae9a4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091604 Aug 22 16:28:24.884938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1066/2060] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:24 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:25.081334 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:25.081951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:25.089251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:25.089748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:25.090189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:25.090908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:25.091403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:25.091834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:25.240983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:25.250384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1de984b7-c24b-4d03-9dd3-1cb132d3455e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.172835 Aug 22 16:28:25.251059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 995/2061] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:25 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:25.544312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:25.545032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:25.552828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:25.553325 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:25.553770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:25.554496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:25.554957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:25.555424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:25.621999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:25.630725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-712ffebe-f8dd-4f8a-831f-e68a14b614a8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.090957 Aug 22 16:28:25.631459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1067/2062] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:25 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:25.916222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:25.916849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:25.922991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:25.923517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:25.923957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:25.924657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:25.925117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:25.925534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:25.944117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:25.990938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:25.999802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a12dfce8-f94a-40e3-85d3-973b4cd13de4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087422 Aug 22 16:28:26.000378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 996/2063] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:25 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:26.273258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:26.273854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:26.280837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:26.281380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:26.281861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:26.282611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:26.283157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:26.283675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:26.418620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:26.427314 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-040adccf-2065-4562-aa4d-e0b208b00d55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.158379 Aug 22 16:28:26.427920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1068/2064] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:26 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:26.652182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:26.652816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:26.659054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:26.659586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:26.660019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:26.660732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:26.661178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:26.661600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:26.726294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:26.735430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4864cbbe-8f50-40d8-aef5-f88a203c1295 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087225 Aug 22 16:28:26.736011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 997/2065] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:27.020920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:27.021521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:27.028224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:27.028762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:27.029239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:27.030111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:27.030676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:27.031783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:27.106751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:27.121487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2d0c7d28-59b3-463a-afc4-5c10db559fea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.104275 Aug 22 16:28:27.122510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1069/2066] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:27 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:27.449057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:27.449662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:27.456952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:27.457454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:27.457894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:27.458604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:27.459059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:27.459523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:27.613673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:27.622220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bffab937-735d-4f93-9191-480e6c64f274 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.177043 Aug 22 16:28:27.622812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 998/2067] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:27 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:27.760710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:27.761695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:27.772652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:27.773494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:27.774251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:27.775501 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:27.776304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:27.777032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:27.850007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:27.865060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-352440e3-fc8a-4901-9771-1639b5ad7608 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.111349 Aug 22 16:28:27.866083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1070/2068] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:28.143653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:28.144673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:28.148477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=76 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:28.154808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:28.155299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:28.155769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:28.156497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:28.156948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:28.157374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:28.227814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:28.237002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-64041aea-5404-4cb0-8f16-843dc058aa31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.097573 Aug 22 16:28:28.237874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 999/2069] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:28 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:28.645423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:28.646055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:28.652854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:28.653338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:28.653781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:28.654480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:28.654929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:28.655378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:28.793901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:28.803103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6237e090-b61c-408b-ba39-a2db4c4b6a28 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161808 Aug 22 16:28:28.803721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1071/2070] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:28 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:28.888003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:28.888648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:28.895037 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:28.895570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:28.896019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:28.896756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:28.897216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:28.897641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:28.964606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:28.974042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a2d5f2b4-77b2-471f-b38f-d0b9094a396d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089740 Aug 22 16:28:28.974623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1000/2071] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:29.259592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:29.260204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:29.262112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=84 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:29.267535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:29.268010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:29.268434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:29.269152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:29.269598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:29.270015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:29.336377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:29.345156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d9a23604-751e-4201-994a-7cc17d187b92 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089578 Aug 22 16:28:29.345731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1072/2072] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:29 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:29.827440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:29.828652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:29.835737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:29.836232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:29.836671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:29.837393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:29.837849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:29.838313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:29.976426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:29.985045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-73e31513-a413-4b14-9de8-6896344fa9d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161639 Aug 22 16:28:29.985614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1001/2073] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:29 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:29.996185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:29.997031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:30.005014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:30.005563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:30.006039 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:30.006930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:30.007476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:30.007975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:30.072664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:30.081820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5d273a8e-8cb1-4ab4-807a-5750608e0728 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089507 Aug 22 16:28:30.082279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1073/2074] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:30.366476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:30.367013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:30.373284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:30.373766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:30.374217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:30.374982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:30.375463 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:30.375888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:30.445706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:30.461176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-62e63e92-2257-4cca-9298-d5a0f951db2b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.098438 Aug 22 16:28:30.462244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1002/2075] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:30 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:31.007498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:31.008391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:31.016429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:31.016915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:31.017348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:31.018095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:31.018541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:31.018962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:31.107482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:31.108656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:31.118972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:31.119815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:31.120434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:31.121319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:31.121958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:31.122519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:31.184717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:31.194219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-df26b9c0-d309-444e-9ead-6b4a29e64aa2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.191397 Aug 22 16:28:31.194927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1074/2076] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:31 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:31.201345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:31.215624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4ab10f66-2587-40ea-a1c4-16931cd33df2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.115475 Aug 22 16:28:31.217141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1003/2077] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:31.496110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:31.496771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:31.503600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:31.504080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:31.504515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:31.505216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:31.505665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:31.506084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:31.570757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:31.579231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e34d051-cca6-45fb-a839-f240e5667f73 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086930 Aug 22 16:28:31.579828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1075/2078] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:31 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:32.229900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:32.230540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:32.238569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:32.239256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:32.239844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:32.240677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:32.241233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:32.241757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:32.242664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:32.243847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:32.254963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:32.255844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:32.256630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:32.257848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:32.258683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:32.259481 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:32.364849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:32.374668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-90362102-52ff-42ef-b3b3-7a5686a204d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.139083 Aug 22 16:28:32.375825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1076/2079] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:32.411470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:32.425837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-759569b2-265a-4ab0-a493-4037c7a3c646 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.199624 Aug 22 16:28:32.426546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1004/2080] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:32 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:32.604995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:32.606093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:32.616542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:32.617395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:32.618152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:32.619350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:32.620149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:32.620901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:32.707932 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:32.716007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5936fdda-5bbb-421c-9e4a-cf673f16bd09 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.118458 Aug 22 16:28:32.716587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1077/2081] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:32 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:33.398723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:33.399890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:33.408364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:33.408928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:33.409426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:33.410316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:33.410899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:33.411424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:33.450844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:33.452307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:33.464785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:33.465514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:33.466044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:33.466899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:33.467563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:33.468137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:33.493373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:33.504894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-81428afa-8da7-4a97-8abd-8016fb83f096 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.109975 Aug 22 16:28:33.506218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1005/2082] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:33.631236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:33.634922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:33.641416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c3693efe-c57f-4ee0-a5ab-e7da951315b0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.196185 Aug 22 16:28:33.642008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1078/2083] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:33 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:33.739012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:33.739577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:33.745869 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:33.746353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:33.746787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:33.747531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:33.747983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:33.748408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:33.815547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:33.824384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-097a3890-925e-4ea9-8938-571ba94dae32 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090428 Aug 22 16:28:33.824990 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1006/2084] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:33 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:34.533331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:34.534364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:34.543164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:34.543829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:34.544381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:34.545260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:34.545833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:34.546442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:34.617465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:34.627055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-57dda9eb-94e7-404d-b538-5afb7521b3cf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.098909 Aug 22 16:28:34.627842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1079/2085] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:34.664027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:34.664737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:34.672094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:34.672633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:34.673115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:34.673910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:34.674476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:34.674947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:34.821444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:34.830135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e7bc237a-3f43-4b31-ae3e-332ee5f22ea9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.171090 Aug 22 16:28:34.830713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1007/2086] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:34 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:34.845931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:34.846612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:34.853127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:34.853619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:34.854208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:34.854925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:34.855411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:34.855845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:34.922605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:34.930783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-43db72c7-515f-4d36-8be5-a9199060a2fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088983 Aug 22 16:28:34.931714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1080/2087] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:34 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:35.652983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:35.654086 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:35.664127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:35.665016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:35.665681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:35.666906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:35.667706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:35.668446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:35.741436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:35.750937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e6175728-4057-4f26-9792-60eaa0c7ba0b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.105235 Aug 22 16:28:35.751567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1008/2088] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:35.867590 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:35.868686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:35.880465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:35.881298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:35.882007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:35.883230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:35.884058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:35.884809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:35.957074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:35.958357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:35.969660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:35.970594 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:35.971363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:35.972545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:35.973557 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:35.974299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:36.061893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:36.068135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:36.076004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b8aaa973-487c-4c8a-a0f6-369611ac88e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.125780 Aug 22 16:28:36.076743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-587702a1-ad46-48b1-b001-383902fcea55 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.216429 Aug 22 16:28:36.077364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1009/2089] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:35 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:36.077565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1081/2090] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:35 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:36.783035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:36.783704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:36.790739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:36.791233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:36.791721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:36.792446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:36.792903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:36.793327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:36.861480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:36.870571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0f57eb05-2d16-4941-bad9-733df6074b1e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091470 Aug 22 16:28:36.871167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1010/2091] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:37.097778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:37.099129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:37.099483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:37.100318 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:37.107249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:37.107618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:37.108050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:37.108258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:37.109235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:37.109444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:37.110141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:37.110341 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:37.110775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:37.110965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:37.111365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:37.111580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:37.228189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:37.237786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c28ee50d-be79-47b5-bcad-8f80f73fa82f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.142891 Aug 22 16:28:37.238376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1011/2092] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:37 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:37.310307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:37.319747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d2260f95-22a5-4377-ae9e-244caf544b8c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.226456 Aug 22 16:28:37.320339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1082/2093] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:37 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:37.894229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:37.894941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:37.902365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:37.902857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:37.903298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:37.904047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:37.904504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:37.904941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:37.971838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:37.981233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bf726c2f-dc19-4930-ba08-26a70530c9ab tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091722 Aug 22 16:28:37.981909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1012/2094] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:38.260624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:38.261288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:38.269071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:38.269562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:38.269999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:38.270719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:38.271179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:38.271638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:38.341597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:38.345118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:38.346157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:38.355534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e2bd6ff4-e9c1-415d-8690-bb22db07352c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.098539 Aug 22 16:28:38.356532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1083/2095] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:38 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:38.356848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:38.357449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:38.358317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:38.359685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:38.360509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:38.361298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:38.370152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:38.518931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:38.534588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-238a88fc-26d9-4600-898c-bf892ed27880 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.196002 Aug 22 16:28:38.535808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1013/2096] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:38 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:39.003362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:39.003982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:39.010388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:39.010877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:39.011317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:39.012113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:39.012574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:39.013002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:39.078035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:39.086798 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0218378f-0bdf-42fb-b7e4-4128e30ee68a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087985 Aug 22 16:28:39.087412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1084/2097] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:39.390388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:39.391009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:39.397797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:39.398282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:39.398716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:39.399450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:39.399906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:39.400326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:39.464514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:39.472985 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6746b88c-20c6-413f-93d5-e89d92dfdf94 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086518 Aug 22 16:28:39.473850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1014/2098] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:39 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:39.569133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:39.569806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:39.576539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:39.577023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:39.577459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:39.578173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:39.578626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:39.579048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:39.994090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:40.003448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d2df93ba-29f5-43f8-b0ac-bbe15d7abf0a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.438116 Aug 22 16:28:40.004046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1085/2099] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:39 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:40.108591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:40.109217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:40.115554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:40.116043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:40.116488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:40.117196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:40.117648 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:40.118080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:40.181814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:40.190818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6fd60c9a-6003-48e4-88e9-163f9d4d13f1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086139 Aug 22 16:28:40.191382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1015/2100] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:40.495287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:40.495891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:40.503160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:40.503683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:40.504124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:40.504861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:40.505321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:40.505747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:40.576754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:40.585682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7bffa382-504c-43ce-9c29-6d095bbd5da8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094759 Aug 22 16:28:40.586391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1086/2101] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:40 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:41.025699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:41.026428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:41.033801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:41.034340 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:41.034818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:41.035605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:41.036105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:41.036583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:41.179677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:41.189222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ba081a07-3789-47e9-8989-c948fffd82c6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.167421 Aug 22 16:28:41.189808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1016/2102] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:41 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:41.216201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:41.217296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:41.226200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:41.226796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:41.227306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:41.228151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:41.228648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:41.229121 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:41.299309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:41.313306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dc834c1c-05cf-4e1e-9757-9fbcfc568b6d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.104371 Aug 22 16:28:41.314050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1087/2103] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:41.608119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:41.609506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:41.616517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:41.617179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:41.617913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:41.618952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:41.619536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:41.620013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:41.688101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:41.696913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7a26f927-8419-4ef8-9448-50d9aa0aaf5f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093284 Aug 22 16:28:41.697550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1017/2104] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:41 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:42.225268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:42.225942 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:42.233078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:42.234283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:42.234853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:42.236082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:42.236652 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:42.237189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:42.336954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:42.337866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:42.346449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:42.347246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:42.347983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:42.349224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:42.349782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:42.350564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:42.386355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:42.399213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5cf242b0-f9dd-4d81-b8f1-d8f53e8e3291 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.178092 Aug 22 16:28:42.400700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1088/2105] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:42 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:42.426438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:42.435316 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-33d0be35-6233-44e6-8dd9-9ebf5707030d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.102464 Aug 22 16:28:42.435937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1018/2106] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:42.718478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:42.719123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:42.725770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:42.726256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:42.726695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:42.727445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:42.727904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:42.728368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:42.794574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:42.802589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6a3ab46e-f872-49f6-afc8-863882c42930 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087961 Aug 22 16:28:42.803174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1089/2107] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:42 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:43.423117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:43.423844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:43.430661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:43.431199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:43.431722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:43.432478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:43.432976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:43.433560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:43.457710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:43.458587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:43.467227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:43.467970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:43.468644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:43.469460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:43.470031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:43.470568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:43.582485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:43.590988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9b5153bb-8fda-4328-adbf-9a2293ed6dbf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.137630 Aug 22 16:28:43.591663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1090/2108] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:43.672324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:43.681009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-020d53b7-cdb2-485a-ae1b-028cef49e4f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.261644 Aug 22 16:28:43.681492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1019/2109] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:43 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:43.824178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:43.824812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:43.831463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:43.831963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:43.832419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:43.833166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:43.833632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:43.834060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:43.899726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:43.908721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-038643bc-e5e2-4683-ae74-f2e4b8519326 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088453 Aug 22 16:28:43.909480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1091/2110] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:43 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:44.612832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:44.613520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:44.620791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:44.621288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:44.621725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:44.622471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:44.622933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:44.623391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:44.703495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:44.704426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:44.711722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:44.712215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:44.712651 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:44.713375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:44.713834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:44.714461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:44.725013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:44.740201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ebfbd6ed-3a40-4d32-9c8b-057d1f4e289d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.130913 Aug 22 16:28:44.741199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1020/2111] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:44.856502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:44.865046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-94a7c002-9851-49f2-842a-958bb1568d11 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.165976 Aug 22 16:28:44.865644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1092/2112] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:44 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:44.930284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:44.930935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:44.937662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:44.938145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:44.938589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:44.939294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:44.939783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:44.940207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:45.007964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:45.017928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-173ac738-005b-4820-a397-81aabc468813 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091521 Aug 22 16:28:45.018503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1021/2113] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:44 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:45.847008 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:45.847664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:45.855988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:45.856470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:45.856905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:45.857607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:45.858059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:45.859063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:45.886707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:45.887376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:45.894111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:45.894597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:45.895036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:45.895787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:45.896243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:45.896669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:45.927809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:45.936495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-280fa3e8-256c-47d9-86c5-5229cc6ff49f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.166805 Aug 22 16:28:45.937083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1093/2114] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:46.036301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:46.038012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:46.038627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:46.044604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:46.044802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-26ce1022-6761-413b-95c2-f5412202efd5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161962 Aug 22 16:28:46.045082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:46.045220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1022/2115] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:45 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:46.045511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:46.046965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:46.047446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:46.047871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:46.113470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:46.121804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e1816abd-72f8-4f9f-ab53-d5936c5963c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087601 Aug 22 16:28:46.122384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1094/2116] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:46 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:46.958414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:46.959074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:46.965460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:46.965943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:46.966361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:46.967046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:46.967537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:46.967957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:47.033921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:47.043265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-920157dc-1dea-4377-9848-6815f12ac791 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088682 Aug 22 16:28:47.043845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1023/2117] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:47.066864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:47.067569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:47.073937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:47.074431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:47.074871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:47.075608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:47.076071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:47.076497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:47.095086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:47.142438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:47.143057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:47.149211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:47.149694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:47.150131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:47.150835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:47.151279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:47.151727 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:47.226478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:47.235251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-41833386-7cce-40ab-a9ae-a7b9dc225ba5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.096850 Aug 22 16:28:47.235882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1024/2118] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:47 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:47.242774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:47.251564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9e22a5e7-21b6-41b6-b471-c799ca6babbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.188614 Aug 22 16:28:47.252159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1095/2119] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:47 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:48.065164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:48.065812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:48.072468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:48.072955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:48.073389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:48.074093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:48.074548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:48.074973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:48.166386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:48.174889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5ff8c00b-35ae-4a28-9076-fad493825263 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.114199 Aug 22 16:28:48.175476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1025/2120] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:48.260264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:48.261307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:48.272745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:48.273355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:48.273528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:48.274252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:48.275038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:48.276330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:48.277138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:48.277901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:48.279520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:48.280006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:48.280440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:48.281133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:48.281589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:48.282011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:48.386769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:48.396009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-50e84256-212e-4daf-bfea-da6ff3aad0af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.143152 Aug 22 16:28:48.396731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1096/2121] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:48 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:48.462069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:48.470769 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7e2ef945-3eaa-4748-a534-0ddd5c0ae1a0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.201838 Aug 22 16:28:48.471364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1026/2122] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:48 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:49.197764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:49.198514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:49.205451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:49.205970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:49.206409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:49.207112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:49.207590 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:49.208016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:49.273362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:49.283211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-108b832f-db79-42bb-a5b2-0b1bbc28d6f9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089388 Aug 22 16:28:49.284079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1097/2123] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:49.418551 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:49.419207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:49.425928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:49.426402 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:49.426828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:49.427563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:49.428009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:49.428426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:49.494754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:49.495634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:49.497877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:49.504658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:49.505122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:49.505792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:49.506505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:49.506958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:49.507396 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:49.512726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a225d136-b6a6-4fd4-983e-7c66a511d8fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.097864 Aug 22 16:28:49.513695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1027/2124] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:49 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:49.687572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:49.702767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9faa01d0-d4d6-4530-9495-d2074a52ba81 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.212163 Aug 22 16:28:49.703824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1098/2125] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:49 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:50.304913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:50.305558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:50.312511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:50.312995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:50.313431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:50.314150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:50.314601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:50.315021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:50.385449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:50.394974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-206b939b-176a-489d-adf0-0459e27b5a67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093958 Aug 22 16:28:50.395657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1028/2126] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:50.535507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:50.536474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:50.544773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:50.545369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:50.546714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:50.547557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:50.548080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:50.548547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:50.616778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:50.625410 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-69f9c4d9-8b70-4cbd-965d-7e64778b2a44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093886 Aug 22 16:28:50.626044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1099/2127] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:50 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:50.740410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:50.741071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:50.748006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:50.748494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:50.748956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:50.749678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:50.750140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:50.750574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:50.904655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:50.908902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:50.914680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-68e648f4-4957-48b5-a6fd-e2f95381adb0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.179466 Aug 22 16:28:50.915269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1029/2128] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:50 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:51.429152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:51.429785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:51.436554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:51.437036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:51.437477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:51.438182 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:51.438641 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:51.439131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:51.504154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:51.513755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dfd68b24-e184-4ede-9b8a-49015d7ef2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088435 Aug 22 16:28:51.514912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1100/2129] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:51.646878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:51.647516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:51.654077 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:51.654568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:51.655686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:51.656402 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:51.656853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:51.657276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:51.724837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:51.738776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bffa4dfe-08c6-4675-8b7d-a0f3dc58c202 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095569 Aug 22 16:28:51.739849 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1030/2130] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:51 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:51.936592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:51.937290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:51.944387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:51.944921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:51.945397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:51.946185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:51.946765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:51.947249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:52.091379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:52.100157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0d167ba5-6132-4b46-b7a6-0ea64098821c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168123 Aug 22 16:28:52.100735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1101/2131] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:51 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:52.536041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:52.536772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:52.546211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:52.546906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:52.547537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:52.548363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:52.548927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:52.549544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:52.614665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:52.623300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1baaaa3f-0069-4c01-bb40-956dc537a474 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091252 Aug 22 16:28:52.623961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1031/2132] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:52.774059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:52.774688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:52.781277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:52.781761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:52.782202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:52.782901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:52.783384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:52.783810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:52.850445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:52.858633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-10e5e83a-b7a2-4e2f-b684-fa06483cd1ba tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088437 Aug 22 16:28:52.859215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1102/2133] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:52 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:53.123409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:53.124117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:53.130471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:53.131007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:53.131552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:53.132317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:53.132816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:53.133301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:53.280825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:53.289464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-426234b7-305c-4ddf-af70-ffeb69caeb19 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170346 Aug 22 16:28:53.290073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1032/2134] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:53 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:53.644692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:53.645465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:53.652175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:53.652663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:53.653098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:53.653806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:53.654268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:53.654696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:53.737508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:53.746337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-68aba34c-1220-451b-9c09-85ae01e1463e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.105536 Aug 22 16:28:53.746929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1103/2135] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:53.891158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:53.891837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:53.898524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:53.899128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:53.899693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:53.900448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:53.900969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:53.901442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:53.966788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:53.975878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0f8a6664-230b-4182-be2d-708f25bd00c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088556 Aug 22 16:28:53.976459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1033/2136] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:53 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:54.311193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:54.311839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:54.318151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:54.318722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:54.319204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:54.319992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:54.320504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:54.320972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:54.474889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:54.490164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ecf4bb14-4c35-4b53-b4c9-468f19a33a3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.182454 Aug 22 16:28:54.491243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1104/2137] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:54 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:54.768534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:54.769151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:54.775639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:54.776126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:54.776567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:54.777272 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:54.777766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:54.778155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:54.844403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:54.853970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f40011f9-d481-4df8-a7a4-3348454b3ba6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089355 Aug 22 16:28:54.854715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1034/2138] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:54.998425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:54.999079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:55.006162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:55.006776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:55.007224 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:55.007997 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:55.008455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:55.008883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:55.078238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:55.086378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fb01d2f6-8509-4a4d-b868-d3e232f20c3e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091895 Aug 22 16:28:55.086954 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1105/2139] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:54 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:55.514931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:55.515978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:55.522881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:55.523396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:55.523836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:55.524553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:55.525020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:55.525440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:55.669080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:55.678091 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c0c5e462-e119-4c21-81d6-a223d969fc8e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168405 Aug 22 16:28:55.678698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1035/2140] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:55 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:55.875915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:55.876584 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:55.882717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:55.883200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:55.883666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:55.884362 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:55.884814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:55.885238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:55.948722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:55.957703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bcef6a58-f8e1-4181-858a-96059ef7b503 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085731 Aug 22 16:28:55.958276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1106/2141] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:56.119224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:56.119816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:56.126003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:56.126482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:56.126919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:56.127654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:56.128105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:56.128526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:56.191537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:56.199618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c2df9d8f-2667-44a7-96b9-3179405671b0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084284 Aug 22 16:28:56.200199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1036/2142] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:56 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:56.700283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:56.700973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:56.707944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:56.708434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:56.708870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:56.709574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:56.710024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:56.710449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:56.849012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:56.858707 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4bdbb57a-9d02-4d50-a6cd-fdf5d8d1ddbf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.162316 Aug 22 16:28:56.859309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1107/2143] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:56 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:56.979831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:56.980475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:56.988188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:56.988682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:56.989123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:56.989854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:56.990310 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:56.990738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:57.061041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:57.069872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-100d141c-df83-43c4-9cec-6bcad970d2fa tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093817 Aug 22 16:28:57.070474 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1037/2144] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:57.222456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:57.223132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:57.230320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:57.230912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:57.231445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:57.232250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:57.233406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:57.233899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:57.297661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:57.305801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fe0c668f-8872-46e0-9b6a-a95df812675a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088489 Aug 22 16:28:57.306405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1108/2145] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:57 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:57.881199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:57.881822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:57.888433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:57.888919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:57.889913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:57.890670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:57.891126 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:57.891581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:58.054033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:58.064112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a746dc95-4366-4031-9c43-7c243852be3a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.186922 Aug 22 16:28:58.064725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1038/2146] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:57 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:58.093063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:58.093689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:58.100881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:58.101375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:58.101821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:58.102551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:58.103013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:58.103488 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:58.172526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:58.182154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-34105983-c279-40ff-8435-c07facc77c7f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093316 Aug 22 16:28:58.182749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1109/2147] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:58.327356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:58.328048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:58.330238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=80 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:58.336619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:58.337164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:58.337646 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:58.338403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:58.338950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:58.339465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:58.409735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:58.418072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-24714d2e-2ec5-4337-86be-cac83e498343 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094684 Aug 22 16:28:58.418655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1039/2148] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:58 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:28:59.086331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:59.086961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:59.094591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:59.095305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:59.095549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:59.096284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:59.096753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:59.097183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:59.205167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:59.206059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:59.212935 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:59.213683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:59.214188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:59.214989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:59.215477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:59.215905 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:59.295308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:59.304077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-354a3d07-43f5-4214-9245-114bc90c99bf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.221743 Aug 22 16:28:59.304671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1110/2149] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:59 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:59.328864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:59.338952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ac6b32f0-cb6a-4bda-b521-fd427b65f6b4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.138340 Aug 22 16:28:59.339567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1040/2150] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:28:59.441116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:28:59.441743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:28:59.443767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=78 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:28:59.449494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:59.449990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:59.450427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:59.451152 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:28:59.452247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:28:59.452682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:28:59.543057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:28:59.552339 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7cd88805-f403-4f5f-8887-0d168fe43fce tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.115128 Aug 22 16:28:59.552988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1111/2151] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:28:59 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:00.328177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:00.329179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:00.335680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:00.336161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:00.336597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:00.337298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:00.337745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:00.338168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:00.361848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:00.362713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:00.369744 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:00.370381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:00.371053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:00.372346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:00.373156 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:00.373902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:00.381701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:00.480231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:00.490341 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-96921187-0781-4db9-aa84-2c046f194b6b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.132983 Aug 22 16:29:00.491027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1112/2152] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:00.524548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:00.533978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-042d76a1-2816-4ace-9790-f59a3e38888d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.210882 Aug 22 16:29:00.534565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1041/2153] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:00 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:00.574747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:00.575401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:00.582626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:00.583029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:00.583586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:00.584304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:00.584761 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:00.585187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:00.652268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:00.661708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8bb56151-ed89-461b-ba0d-0f7a9f24a0c2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091118 Aug 22 16:29:00.662324 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1113/2154] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:00 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:01.524770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:01.525387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:01.532970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:01.533455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:01.533919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:01.534644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:01.535141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:01.537161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:01.563122 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:01.564289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:01.575891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:01.576746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:01.577538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:01.578774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:01.579610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:01.580394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:01.606866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:01.616755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4b568b6e-ecf2-4913-8f73-41eae2a65db7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.096525 Aug 22 16:29:01.617644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1042/2155] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:01.682730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:01.683392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:01.690292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:01.690789 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:01.691234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:01.692018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:01.692486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:01.692924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:01.776245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:01.786011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-da8dfd71-15f5-4952-a6b9-3abbd77d5df3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.107241 Aug 22 16:29:01.786761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1043/2156] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:01 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:01.821044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:01.830934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dd8c2446-fd12-44ae-876f-12f97ff64676 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.275248 Aug 22 16:29:01.831629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1114/2157] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:01 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:02.638476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:02.639381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:02.646547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:02.647030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:02.647505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:02.648224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:02.648673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:02.649103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:02.720317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:02.729585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-22e1a5fc-cee1-4c96-ae3f-05c7ae77ecb9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.095034 Aug 22 16:29:02.730166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1044/2158] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:02.808013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:02.809023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:02.816658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:02.817150 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:02.817596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:02.818309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:02.818769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:02.819201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:02.856912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:02.858658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:02.869073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:02.869617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:02.870090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:02.870866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:02.871673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:02.872447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:02.898538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:02.909925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ac50abb8-5058-46fa-b7d5-41fc9324ee9f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.105849 Aug 22 16:29:02.910516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1115/2159] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:02 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:02.928835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:29:02.929454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 (ip 10.222.0.40) !!! Aug 22 16:29:03.030137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:03.039450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57c721e3-623f-4df9-bfa1-ba0a9f4322e0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.189162 Aug 22 16:29:03.040042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1045/2160] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:02 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:03.756730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:03.757822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:03.769007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:03.769885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:03.770671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:03.771947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:03.772773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:03.773551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:03.838161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:03.847087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b7c62bf-ac62-4d8c-8a98-70a7210c492c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.097648 Aug 22 16:29:03.847699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1116/2161] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:03.943688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:03.944407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:03.951007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:03.952398 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:03.953041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:03.953792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:03.954286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:03.954748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:03.974592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:04.023853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:04.032683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eec5e2d3-d3f6-4da7-a3da-4191be3de5a6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092805 Aug 22 16:29:04.033389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1046/2162] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:03 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:04.062301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:04.062913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:04.069071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:04.069549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:04.069980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:04.070677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:04.071124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:04.071579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:04.217562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:04.226330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0445cfa2-b3f3-4640-b7a3-c4089857814f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168408 Aug 22 16:29:04.226912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1117/2163] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:04 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:04.868297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:04.868925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:04.875394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:04.875903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:04.876342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:04.877063 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:04.877517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:04.877943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:04.943482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:04.953570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-79ea4878-15cd-483c-b6a7-2d2745ba1641 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089203 Aug 22 16:29:04.954633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1047/2164] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:04 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:05.054692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:05.055559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:05.063142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:05.063672 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:05.064126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:05.064875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:05.065364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:05.065819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:05.135371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:05.144693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-46d304ea-7143-4518-8b89-1ad698ebb1ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093902 Aug 22 16:29:05.145313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1118/2165] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:05 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:05.248815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:05.249428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:05.255627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:05.256115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:05.256548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:05.257244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:05.257692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:05.258112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:05.427023 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:05.441725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-795b997f-2416-4de4-ab3b-fbd87e0509a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.196688 Aug 22 16:29:05.442768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1048/2166] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:05 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:05.975272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:05.975920 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:05.982422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:05.982912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:05.983367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:05.984081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:05.984557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:05.984953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:06.050705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:06.059677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9d1f4c05-8a1f-406f-851d-0da25070b6c4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088542 Aug 22 16:29:06.060487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1119/2167] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:06.166005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:06.166634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:06.173427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:06.174021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:06.174602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:06.175379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:06.175886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:06.176430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:06.240570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:06.249216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-29347df2-c0b6-47aa-8eb6-3892ffcb4235 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087173 Aug 22 16:29:06.249790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1049/2168] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:06 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:06.467164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:06.467833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:06.474618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:06.475103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:06.475586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:06.476311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:06.476767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:06.477191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:06.619877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:06.635914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5274ec44-bb41-4063-9666-3a4e6d983b4f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.172142 Aug 22 16:29:06.636982 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1120/2169] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:06 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:07.082928 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:07.083564 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:07.089756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:07.090237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:07.090673 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:07.091391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:07.092512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:07.092934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:07.159572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:07.168109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-49650f12-3db8-45eb-8974-678342ef1730 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089708 Aug 22 16:29:07.168932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1050/2170] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:07.270673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:07.271298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:07.277338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:07.277816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:07.278245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:07.278933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:07.279461 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:07.279883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:07.344558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:07.353338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-55e11441-8f0f-4dd1-88bf-97b825436670 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086894 Aug 22 16:29:07.353928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1121/2171] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:07 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:07.658605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:07.659233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:07.666022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:07.666629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:07.667209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:07.668035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:07.668590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:07.669059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:07.813965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:07.822846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-085413f9-b737-46f3-ab61-3cf56f0677dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168928 Aug 22 16:29:07.823445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1051/2172] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:07 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:08.189886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:08.190634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:08.197445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:08.197926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:08.198361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:08.199062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:08.199547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:08.199979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:08.278773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:08.293797 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ec341ec4-89e0-4f4e-96ba-1f974ac9c1b1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.108022 Aug 22 16:29:08.294823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1122/2173] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:08.376019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:08.377085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:08.384329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:08.384998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:08.385560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:08.386792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:08.387507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:08.388064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:08.457373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:08.466025 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3f5885ef-1b4c-473a-b6b9-1d8dfef7104d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094763 Aug 22 16:29:08.466641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1052/2174] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:08 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:08.859596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:08.860240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:08.866825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:08.867318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:08.867800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:08.868531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:08.868992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:08.869424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:09.017747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:09.026498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-106eb837-242d-4f70-b0d3-95d6e01fa9e7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.171374 Aug 22 16:29:09.027104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1123/2175] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:08 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:09.315811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:09.316541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:09.323890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:09.324387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:09.324827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:09.325543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:09.326000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:09.326426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:09.395819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:09.405398 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3787db69-8eb1-4953-beac-134566093bae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093607 Aug 22 16:29:09.406003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1053/2176] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:09.488541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:09.489244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:09.495773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:09.496248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:09.496679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:09.497365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:09.497816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:09.498803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:09.564930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:09.572933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bcc1e122-71e0-4079-9e33-5fbc8cf7d274 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088316 Aug 22 16:29:09.573514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1124/2177] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:09 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:10.047802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:10.048481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:10.055130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:10.055837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:10.056343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:10.057101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:10.057640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:10.058159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:10.200735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:10.209404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e40d708b-e1f3-441d-9c2c-7789e397d36c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.166097 Aug 22 16:29:10.209980 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1054/2178] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:10 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:10.440967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:10.441610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:10.447958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:10.448361 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:10.448795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:10.449492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:10.449939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:10.450358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:10.516785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:10.525519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e3574087-bb72-4b98-aae8-9f2fea43e956 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088352 Aug 22 16:29:10.526215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1125/2179] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:10.598200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:10.599570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:10.611163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:10.612038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:10.612827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:10.614050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:10.614846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:10.615643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:10.704636 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:10.713396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ca60378e-f92c-4933-a8f3-01e9cd2d61c9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.123044 Aug 22 16:29:10.714052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1055/2180] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:10 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:11.233550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:11.234291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:11.241453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:11.241944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:11.242402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:11.243117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:11.243601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:11.244031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:11.394286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:11.402868 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c64acbab-5c75-45fd-983e-441fd36f39e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.174659 Aug 22 16:29:11.403459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1126/2181] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:11 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:11.548718 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:11.549385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:11.556297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:11.556952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:11.557376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:11.558146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:11.558655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:11.559173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:11.631307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:11.639910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8d86f8d-7958-47dc-a2aa-e04fda320ff1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.095674 Aug 22 16:29:11.640496 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1056/2182] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:11.735870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:11.736572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:11.743418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:11.743918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:11.744358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:11.745063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:11.745518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:11.745978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:11.813496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:11.822700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-66a2f8aa-6fb9-46a6-971d-6169aa556947 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091426 Aug 22 16:29:11.823305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1127/2183] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:11 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:12.425122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:12.425728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:12.431878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:12.432374 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:12.432806 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:12.433509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:12.433955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:12.434377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:12.581626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:12.591527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-10e3f9c4-84d2-4b60-b91e-b50ac286bd23 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170243 Aug 22 16:29:12.592205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1057/2184] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:12 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:12.671233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:12.672053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:12.679028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:12.679570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:12.680093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:12.680877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:12.681381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:12.681981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:12.752738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:12.756258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:12.763157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-88cff73a-c570-4b53-831e-094b62cac852 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.096623 Aug 22 16:29:12.764435 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1128/2185] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:12.844169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:12.844862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:12.851838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:12.852319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:12.852749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:12.853450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:12.853898 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:12.854319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:12.930822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:12.939281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5fd37f1c-2f87-4ace-9903-da30f4d5a460 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.099085 Aug 22 16:29:12.939880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1058/2186] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:12 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:13.619663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:13.620280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:13.626540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:13.627026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:13.627510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:13.628217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:13.628666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:13.629101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:13.782249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:13.788586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:13.789696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:13.797327 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7add6486-42e6-4873-af9b-ba8aa7af8f2e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.181347 Aug 22 16:29:13.807415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1129/2187] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:13 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:13.807726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:13.807726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:13.807726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:13.807726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:13.808419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:13.808419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:13.869927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:13.885716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fe27c2d2-9660-4da8-81c4-97c930874d6e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.103229 Aug 22 16:29:13.886580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1059/2188] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:13.973804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:13.974425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:13.980695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:13.981181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:13.981621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:13.982330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:13.982781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:13.983203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:14.052539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:14.061241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-92c311dd-4c96-47db-95d8-cce056ba564c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091571 Aug 22 16:29:14.061827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1130/2189] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:13 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:14.821058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:14.821724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:14.828982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:14.829475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:14.829908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:14.830617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:14.831096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:14.831560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:14.912649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:14.913967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:14.925865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:14.927026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:14.927516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:14.928793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:14.929451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:14.929931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:15.033824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:15.040476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:15.045517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2f346bf1-b0fd-4db5-aff8-1f7111961dc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.139682 Aug 22 16:29:15.046272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1131/2190] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:15.058364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5a1a20dc-5275-4812-8e6f-6b50f5a05074 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.240763 Aug 22 16:29:15.059472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1060/2191] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:14 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:15.099745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:15.100794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:15.112328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:15.113208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:15.114002 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:15.115301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:15.116162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:15.116950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:15.189813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:15.199114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7f58abe7-2315-4fc4-9162-1fdd24a11e8a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.107116 Aug 22 16:29:15.199767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1132/2192] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:15 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:16.071554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:16.072235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:16.079476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:16.079954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:16.080380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:16.081075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:16.081527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:16.081945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:16.096949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:16.097774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:16.106813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:16.107531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:16.108205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:16.109206 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:16.109749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:16.110246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:16.159775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:16.171417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-85811ed1-e224-4645-9c7a-57276699059c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.103848 Aug 22 16:29:16.172226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1061/2193] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:16.221649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:16.222270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:16.229878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:16.230580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:16.231141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:16.231989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:16.232588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:16.233182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:16.274586 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:16.285517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-26b2b970-827a-4dd3-b21e-6adc391517e1 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.193626 Aug 22 16:29:16.286345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1133/2194] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:16 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:16.317473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:16.325633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-38ff4e38-73cc-4e70-b10c-152006b85890 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.108624 Aug 22 16:29:16.326623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1062/2195] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:16 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:17.195249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:17.195968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:17.202522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:17.203007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:17.203477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:17.204181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:17.204635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:17.205062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:17.271975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:17.281097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8bb64f8c-752d-4dd4-b151-bb062b56441b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.090719 Aug 22 16:29:17.281735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1134/2196] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:17.319361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:17.320212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:17.327883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:17.328725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:17.329518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:17.330783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:17.332016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:17.332768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:17.340762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:17.350810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:17.351986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:17.363013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:17.363893 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:17.364647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:17.365878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:17.366680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:17.367449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:17.465913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:17.476231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-603c3ff6-0986-4d9b-aefd-a00213d93dbc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.132741 Aug 22 16:29:17.476833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1135/2197] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:17 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:17.519943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:17.535247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e8eb1079-d109-4111-83c8-edb2f0f48757 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.219293 Aug 22 16:29:17.536311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1063/2198] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:17 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:18.303252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:18.303973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:18.311053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:18.311576 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:18.312012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:18.312718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:18.313168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:18.313601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:18.379006 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:18.387318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-402321c4-7548-460d-8865-e31fa1ffe41e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087976 Aug 22 16:29:18.387908 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1136/2199] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:18.511459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:18.512460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:18.519897 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:18.520385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:18.520813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:18.521508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:18.521956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:18.522375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:18.562044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:18.562757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:18.569860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:18.570540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:18.571096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:18.572117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:18.572725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:18.573285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:18.599247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:18.608822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-30dcc58d-368c-4774-aa40-ed3dc9386fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.102448 Aug 22 16:29:18.609512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1064/2200] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:18 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:18.717604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:18.726198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7bc306a-ca0f-414a-8358-b3e88af8cd1c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168963 Aug 22 16:29:18.726770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1137/2201] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:18 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:19.409261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:19.409944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:19.416898 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:19.417388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:19.417885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:19.418607 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:19.419064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:19.420098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:19.489956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:19.498623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-681e70a2-c92b-4fc0-a4df-9d45c8729615 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093403 Aug 22 16:29:19.499209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1065/2202] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:19.630486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:19.631144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:19.637770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:19.638251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:19.638690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:19.639412 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:19.639872 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:19.640290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:19.703429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:19.711630 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9f558e10-bd9f-4bd9-bdf4-e485b4a856ec tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085150 Aug 22 16:29:19.712203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1138/2203] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:19 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:19.747059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:19.747754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:19.754232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:19.754713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:19.755151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:19.755871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:19.756329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:19.756752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:19.898737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:19.907844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-edaf425e-0249-43aa-be64-22ea46e6935a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.164495 Aug 22 16:29:19.908431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1066/2204] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:19 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:20.520029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:20.520655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:20.527504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:20.527996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:20.528431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:20.529161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:20.529621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:20.530050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:20.600500 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:20.609414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6c56c290-e0fd-4da3-b7d2-c2432c037585 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093368 Aug 22 16:29:20.609999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1139/2205] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:20.734127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:20.734782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:20.741859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:20.742622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:20.743075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:20.743934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:20.744385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:20.744903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:20.813579 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:20.821770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-977c63b3-ca0d-487e-ac15-c767b6490c34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092244 Aug 22 16:29:20.822359 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1067/2206] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:20 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:20.942845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:20.943506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:20.949952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:20.950434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:20.950881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:20.951611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:20.952070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:20.952498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:21.096486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:21.105157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4967992e-0065-469d-91f5-d642d051c5d7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.166353 Aug 22 16:29:21.105733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1140/2207] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:20 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:21.630345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:21.630879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:21.637695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:21.638958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:21.639186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:21.639931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:21.640386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:21.640809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:21.729846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:21.738547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4ff9999a-2b01-4126-8b3b-001ef3a004db tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.112103 Aug 22 16:29:21.739131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1068/2208] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:21.843178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:21.843847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:21.850717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:21.851203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:21.851690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:21.852477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:21.852949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:21.853385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:21.920065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:21.928434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-beab67d2-caa9-4b13-ab51-cb05af207176 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089178 Aug 22 16:29:21.929041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1141/2209] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:21 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:22.140065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:22.140702 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:22.147157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:22.147680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:22.148119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:22.148817 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:22.149269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:22.149690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:22.290401 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:22.299741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2d7bb84a-a501-4ba9-a711-0d618a9257fb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.163439 Aug 22 16:29:22.300314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1069/2210] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:22 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:22.760680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:22.761333 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:22.768297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:22.768785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:22.769222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:22.769930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:22.770398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:22.770814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:22.836289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:22.850681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-72a7c2c9-99c8-42e5-8755-c8bdc4102807 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093488 Aug 22 16:29:22.851768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1142/2211] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:22.950425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:22.951627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:22.958106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:22.958599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:22.959034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:22.959786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:22.960236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:22.960661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:23.025113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:23.033768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5832ab32-351e-4929-a8d2-6d00fc5777c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087479 Aug 22 16:29:23.034348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1070/2212] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:22 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:23.335272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:23.335950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:23.343402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:23.343891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:23.344329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:23.345056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:23.345534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:23.345960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:23.493087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:23.501974 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-79c21052-cd25-4038-990e-b96199cc0bfe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170712 Aug 22 16:29:23.502579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1143/2213] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:23 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:23.885360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:23.886111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:23.893161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:23.893652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:23.894085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:23.894785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:23.895231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:23.895676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:23.959164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:23.967707 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cd0c600d-45b7-49f1-ad7f-d8e4e8da1b60 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086477 Aug 22 16:29:23.968290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1071/2214] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:24.069088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:24.069957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:24.078483 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:24.079028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:24.079598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:24.080455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:24.080984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:24.081519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:24.148423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:24.156828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3cdd70e2-5e84-4e68-8225-b1fbbc4c12aa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092056 Aug 22 16:29:24.157647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1144/2215] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:24 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:24.526874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:24.527531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:24.534464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:24.534996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:24.535476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:24.536246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:24.536709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:24.537134 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:24.688390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:24.697508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-13a36872-576a-4c1b-88a4-4fcbd7175fe5 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.174777 Aug 22 16:29:24.698104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1072/2216] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:24 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:25.002160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:25.002808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:25.009120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:25.009621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:25.010052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:25.010757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:25.011209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:25.011677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:25.033154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:25.079661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:25.089340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-64b44796-a846-47e4-884d-f18ac696ff37 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.090868 Aug 22 16:29:25.090109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1145/2217] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:25.177271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:25.177954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:25.184722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:25.185209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:25.185644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:25.186351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:25.186804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:25.187228 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:25.253661 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:25.261807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8a818461-e14d-4672-a994-1b50744bcc2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088341 Aug 22 16:29:25.262396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1073/2218] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:25 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:25.720374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:25.721016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:25.728398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:25.728897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:25.729342 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:25.730096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:25.730565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:25.731000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:25.884538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:25.894532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a7cd2734-0e7d-4d1a-a22f-1fc789185c49 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.178251 Aug 22 16:29:25.895145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1146/2219] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:25 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:26.112703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:26.113303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:26.119478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:26.119961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:26.120395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:26.121092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:26.121542 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:26.121969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:26.188263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:26.197892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fcbf411f-8410-4b5c-a74c-18892f1bd07c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089290 Aug 22 16:29:26.198526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1074/2220] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:26.282891 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:26.283620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:26.290105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:26.290587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:26.291025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:26.291743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:26.292197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:26.292621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:26.357358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:26.365395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2b9c0044-46dd-4fb7-9685-dfddeb4bd084 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086749 Aug 22 16:29:26.365909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1147/2221] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:26 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:26.916114 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:26.916725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:26.923650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:26.924131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:26.924565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:26.925291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:26.925742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:26.926165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:27.072435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:27.081296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2c13050a-3e0e-44d7-9a5f-894e6e45e35a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168978 Aug 22 16:29:27.081887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1075/2222] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:26 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:27.219044 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:27.219598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:27.226125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:27.226608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:27.227051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:27.227783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:27.228238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:27.228662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:27.292085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:27.301441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-11f7a24f-731e-4402-9d35-0097d9e9288a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087120 Aug 22 16:29:27.302016 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1148/2223] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:27.385764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:27.386419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:27.393053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:27.393538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:27.393974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:27.394674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:27.395123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:27.395577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:27.463238 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:27.471946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7447baf1-f1c6-4746-acf2-fd4c82ccc47e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089920 Aug 22 16:29:27.472451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1076/2224] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:27 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:28.103972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:28.104608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:28.112407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:28.112913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:28.113335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:28.114060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:28.114520 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:28.114948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:28.254312 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:28.262887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-adff6b08-8add-4c7c-9457-092e5e047906 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.163268 Aug 22 16:29:28.263542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1149/2225] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:28 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:28.322619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:28.323233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:28.330166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:28.330658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:28.331098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:28.331864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:28.332363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:28.332791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:28.402891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:28.412226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-edf29678-ef69-4e40-a1be-d3cdfff1af51 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.093639 Aug 22 16:29:28.412825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1077/2226] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:28.493167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:28.494095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:28.501005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:28.501499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:28.501949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:28.502680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:28.503172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:28.503648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:28.588075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:28.597497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-adbca945-0074-410f-a027-7c28f2da138d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.108370 Aug 22 16:29:28.598146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1150/2227] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:28 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:29.284455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:29.285068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:29.287041 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=78 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:29.293813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:29.294299 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:29.294735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:29.295471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:29.295923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:29.296347 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:29.435711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:29.436429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:29.444311 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:29.445183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:29.445968 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:29.447294 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:29.448198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:29.448960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:29.456772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:29.467158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2f4d754c-c45f-402e-b72e-ec18e51b5133 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.186486 Aug 22 16:29:29.468013 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1078/2228] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:29 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:29.523022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:29.533279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3d8c21ee-4a9d-416e-84d9-55196732d560 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.102220 Aug 22 16:29:29.533903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1151/2229] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:29.619429 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:29.620043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:29.626822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:29.627306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:29.627783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:29.628481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:29.628929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:29.629352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:29.694972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:29.701375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:29.711492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d75a27e9-6525-4cd8-93af-1f02faae485a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095618 Aug 22 16:29:29.712492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1079/2230] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:29 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:30.490526 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:30.491141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:30.493670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=82 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:30.499605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:30.500096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:30.500536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:30.501246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:30.501696 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:30.502149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:30.558677 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:30.559296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:30.566961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:30.567577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:30.568115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:30.569039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:30.569417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:30.569852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:30.651866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:30.662283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-41777775-73be-423b-8832-7340c520cd67 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.107651 Aug 22 16:29:30.662888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1080/2231] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:30.708439 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:30.721726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dbc70af4-9cb4-426f-830a-acb3b6049735 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.234752 Aug 22 16:29:30.722706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1152/2232] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:30 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:30.748069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:30.748763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:30.755892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:30.756566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:30.757071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:30.757862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:30.758380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:30.758848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:30.826131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:30.839887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b9d33863-0c31-4a5c-9b37-3b37550ae181 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.096885 Aug 22 16:29:30.840919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1081/2233] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:30 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:31.694483 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:31.695105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:31.702349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:31.702836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:31.703266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:31.704032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:31.704482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:31.704905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:31.744079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:31.744712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:31.751711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:31.752203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:31.752637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:31.753335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:31.753787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:31.754209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:31.772380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:31.781529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-00bcc9b7-3da2-4d4c-af2b-6bff44146cf1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091013 Aug 22 16:29:31.782210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1153/2234] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:31.860980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:31.861591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:31.868551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:31.869266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:31.869889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:31.870812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:31.871648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:31.872543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:31.903050 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:31.912296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-18dcbb4c-7b23-4b42-beda-3aa59a4d459a tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.172104 Aug 22 16:29:31.912900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1082/2235] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:31 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:31.961766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:31.969749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-63ddf2ad-3777-4cc1-82f1-1a25d96f6e58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.112678 Aug 22 16:29:31.970363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1154/2236] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:31 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:32.802671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:32.803260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:32.809833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:32.810317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:32.810953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:32.811699 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:32.812144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:32.812559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:32.875813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:32.884379 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2573f225-11fd-4971-b60a-e1d8d715a2ec tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085670 Aug 22 16:29:32.884967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1083/2237] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:32.943638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:32.944305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:32.951898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:32.952387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:32.952818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:32.953531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:32.953981 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:32.954409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:32.991821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:32.992487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:33.000701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:33.001357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:33.001917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:33.003045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:33.003657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:33.004219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:33.089411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:33.100839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e22e3b47-993e-4592-aebe-cb0c45fa55eb tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.113149 Aug 22 16:29:33.101437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1084/2238] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:32 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:33.123233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:33.132446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e613456-8073-48c6-adbd-08bfa697a95e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.192699 Aug 22 16:29:33.133065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1155/2239] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:32 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:33.906608 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:33.907223 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:33.913825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:33.914308 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:33.914744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:33.915483 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:33.915936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:33.916364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:33.980117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:33.990072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4ed26e10-aa55-4ccd-8b57-dbc274c88609 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087881 Aug 22 16:29:33.990649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1085/2240] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:34.126802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:34.127507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:34.134447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:34.134935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:34.135398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:34.136109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:34.136565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:34.136990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:34.155302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:34.155938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:34.162239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:34.162637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:34.163074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:34.163805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:34.164279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:34.164686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:34.207567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:34.216666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0918efd3-7d84-4441-9a22-f869babdc010 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093290 Aug 22 16:29:34.217263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1156/2241] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:34 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:34.309713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:34.324320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-168f5231-be12-4543-8273-61b46e0c5e75 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.173740 Aug 22 16:29:34.324919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1086/2242] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:34 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:35.010287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:35.010895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:35.017964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:35.018471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:35.018901 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:35.019619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:35.020069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:35.020593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:35.085117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:35.094644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-63ab6c11-303c-43df-9b7a-b4050105a389 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088089 Aug 22 16:29:35.095237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1157/2243] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:35.238171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:35.238782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:35.245465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:35.245946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:35.246384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:35.247909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:35.248371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:35.249153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:35.320421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:35.329734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d63b255b-4567-40cd-bcd7-e58e50f28aad tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095336 Aug 22 16:29:35.330319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1087/2244] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:35 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:35.345484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:35.346084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:35.353050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:35.353531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:35.354076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:35.354779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:35.355230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:35.355686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:35.504598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:35.514333 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c7a24825-8245-4c67-9fd9-01cdd396755c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.172686 Aug 22 16:29:35.514926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1158/2245] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:35 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:36.116312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:36.116982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:36.123173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:36.123692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:36.124133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:36.124836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:36.125290 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:36.125725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:36.187995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:36.196250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0bf9292b-830b-499c-8865-f48f40ed60c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084002 Aug 22 16:29:36.196841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1088/2246] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:36 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:36.351445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:36.352120 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:36.358686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:36.359167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:36.359634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:36.360326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:36.360774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:36.361195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:36.425320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:36.433167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e4d91d6a-8ae4-475a-afa4-0d2f02e92e8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085821 Aug 22 16:29:36.433738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1159/2247] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:36 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:36.535758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:36.536517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:36.543171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:36.543694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:36.544128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:36.544830 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:36.545279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:36.545706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:36.686044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:36.694654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-15d05d41-df5b-4340-b834-f28e698e81e9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.162714 Aug 22 16:29:36.695271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1089/2248] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:36 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:37.217189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:37.217859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:37.224270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:37.224745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:37.225169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:37.225864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:37.226304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:37.226728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:37.289089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:37.298193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b6b4264-4dca-4726-ba76-c66e8d62b384 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085470 Aug 22 16:29:37.298770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1160/2249] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:37.454437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:37.455065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:37.461257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:37.461740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:37.462177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:37.462882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:37.463358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:37.463781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:37.527453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:37.535941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7083a241-3541-4b0c-97e1-0922cddc15ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085793 Aug 22 16:29:37.537552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1090/2250] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:37 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:37.717517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:37.718172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:37.725890 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:37.726296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:37.726740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:37.727509 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:37.727977 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:37.728409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:37.878046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:37.886917 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6ae87df4-b8b1-461d-a757-3a1dd767292b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.174313 Aug 22 16:29:37.888318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1161/2251] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:37 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:38.320596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:38.321211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:38.328588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:38.329075 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:38.329507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:38.330222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:38.330696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:38.331125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:38.396984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:38.405881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-288b8fe3-d062-4131-b7b8-edb903dcc2f7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089160 Aug 22 16:29:38.406478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1091/2252] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:38.558015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:38.558621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:38.565283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:38.565765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:38.566195 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:38.566876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:38.567345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:38.567763 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:38.571853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:38.629880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:38.637614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f94529bf-ed94-4fb6-afb4-164fb2afe9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083463 Aug 22 16:29:38.638183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1162/2253] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:38 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:38.909776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:38.910358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:38.916325 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:38.916800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:38.917229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:38.917912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:38.918356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:38.918774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:39.048198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:39.056381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4340a883-90d4-4416-8c7f-fd2013733ec8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150590 Aug 22 16:29:39.056955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1092/2254] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:38 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:39.427823 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:39.428443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:39.436109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:39.436593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:39.437058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:39.437736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:39.438194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:39.438619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:39.500883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:39.509952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0149043a-6a87-4296-a5c3-0d39d81d504e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085925 Aug 22 16:29:39.510582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1163/2255] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:39.658040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:39.658653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:39.665145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:39.665626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:39.666062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:39.666751 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:39.667198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:39.667649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:39.729783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:39.738231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bd376333-9e9a-481e-b519-25adb718f3e1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084051 Aug 22 16:29:39.738802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1093/2256] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:39 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:40.078533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:40.079243 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:40.085839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:40.086330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:40.086771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:40.087524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:40.087993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:40.088424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:40.226100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:40.234579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-585ad57c-7f09-4e96-b4f8-9dc870e489a8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.160481 Aug 22 16:29:40.235157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1164/2257] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:40 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:40.531300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:40.531927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:40.538252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:40.538743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:40.539180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:40.539930 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:40.540778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:40.540778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:40.606407 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:40.614952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7a12662c-ce0b-4e5f-8171-5d2075f39066 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087620 Aug 22 16:29:40.615544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1094/2258] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:40.758610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:40.759223 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:40.766459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:40.766881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:40.767356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:40.768057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:40.768519 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:40.768936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:40.832679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:40.841286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-54f2d26f-3463-4d90-ab14-3ff05d9e44f4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086140 Aug 22 16:29:40.841870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1165/2259] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:40 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:41.255883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:41.256430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:41.262908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:41.263428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:41.263867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:41.264558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:41.265007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:41.265426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:41.398395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:41.407188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-47886620-a319-450f-a859-aab122076bf6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155320 Aug 22 16:29:41.407818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1095/2260] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:41 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:41.636187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:41.636821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:41.643422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:41.643899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:41.644332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:41.645017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:41.645468 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:41.645889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:41.707038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:41.716227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bf4d3a1f-19e8-4e76-864f-a037145bb793 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083178 Aug 22 16:29:41.716811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1166/2261] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:41.862831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:41.863466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:41.869424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:41.869899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:41.870331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:41.871011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:41.871490 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:41.871918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:41.890371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:41.933755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:41.942048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-19c05bb3-3c97-414e-9863-7da98cd82dca tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083082 Aug 22 16:29:41.942623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1096/2262] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:41 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:42.429178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:42.429822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:42.436313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:42.436801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:42.437242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:42.437933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:42.438387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:42.438815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:42.572922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:42.582323 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-77b83603-633e-4b41-8320-4bac64205130 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.156945 Aug 22 16:29:42.582925 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1167/2263] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:42 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:42.737539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:42.738097 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:42.745158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:42.745649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:42.746087 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:42.747289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:42.747780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:42.748205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:42.813054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:42.821424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b4560728-3713-484f-bfb9-a0550d21845e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087928 Aug 22 16:29:42.822210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1097/2264] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:42.962636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:42.963268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:42.969931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:42.970426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:42.970984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:42.971645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:42.972113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:42.972591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:43.036750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:43.045338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-684b7533-bb6e-49c0-90e4-8fbe1a938509 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086896 Aug 22 16:29:43.045910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1168/2265] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:42 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:43.604286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:43.604890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:43.611473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:43.611954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:43.612382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:43.613067 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:43.613507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:43.613923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:43.745546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:43.753850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ba805f32-1b67-4d2f-b5fd-8bbce26fbbd6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153393 Aug 22 16:29:43.754422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1098/2266] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:43 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:43.845059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:43.845944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:43.853281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:43.853770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:43.854201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:43.854906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:43.855385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:43.855820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:43.918438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:43.926821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7cc5b60e-cd20-4b06-8a37-3f9895f58b82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087991 Aug 22 16:29:43.927434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1169/2267] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:44.066120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:44.066735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:44.073016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:44.073506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:44.073946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:44.074645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:44.075632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:44.076056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:44.140970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:44.148706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ae303e7e-3c47-4439-9398-033b121bf635 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086606 Aug 22 16:29:44.149267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1099/2268] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:44 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:44.284832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:29:44.285115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:29:44.774979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:44.775683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:44.781846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:44.782331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:44.782775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:44.783512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:44.783952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:44.784378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:44.910460 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:44.919194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bd50f21d-b851-4baf-be54-c5b14deb20cd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.147629 Aug 22 16:29:44.919782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1170/2269] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:44 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:44.947587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:44.948219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:44.954590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:44.955068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:44.955528 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:44.956209 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:44.956655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:44.957072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:45.017580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:45.025912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-007c25e9-4c97-4ad6-be14-c985d5d9cd53 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082206 Aug 22 16:29:45.026491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1100/2270] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:45.170426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:45.170984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:45.177076 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:45.177557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:45.177996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:45.178689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:45.179154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:45.179625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:45.242768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:45.250542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5bcebc19-0be1-422e-bf5d-3dd7fd274fe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084685 Aug 22 16:29:45.251108 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1171/2271] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:45 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:46.047569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:46.048308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:46.055118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:46.055628 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:46.056072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:46.056775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:46.057230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:46.057665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:46.066800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:46.067454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:46.073378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:46.073862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:46.074302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:46.075034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:46.075523 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:46.075950 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:46.353480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:46.362710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-916d83f0-9da7-4214-84df-7d4182e03e9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.319472 Aug 22 16:29:46.363284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1172/2272] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:46 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:46.367963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:46.368572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:46.374882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:46.375454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:46.375898 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:46.376601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:46.377058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:46.377486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:46.449420 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:46.457784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e84c4930-8a64-4513-a700-c1229beefae0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093496 Aug 22 16:29:46.458357 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1173/2273] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:46 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:46.470958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:46.479458 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9524f4b9-dc9d-4c38-a466-e5291440f373 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.542512 Aug 22 16:29:46.480021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1101/2274] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:45 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:47.384338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:47.384967 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:47.392115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:47.392602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:47.393043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:47.393735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:47.394193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:47.394622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:47.458049 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:47.466725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ef8c7c44-b659-4d6a-a19a-bba7f704037c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086230 Aug 22 16:29:47.467310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1174/2275] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:47.478152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:47.478757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:47.485247 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:47.485748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:47.486179 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:47.486862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:47.487306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:47.487760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:47.501638 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:47.502254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:47.508406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:47.508896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:47.509338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:47.510043 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:47.510502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:47.510929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:47.560443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:47.568180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3aba9d7f-88da-48b9-8593-3affff426d91 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093833 Aug 22 16:29:47.568749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1102/2276] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:47 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:47.646222 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:47.654602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ad70f846-39a6-45a6-8132-eb280d9c821f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.156763 Aug 22 16:29:47.655166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1175/2277] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:47 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:48.487758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:48.488350 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:48.494800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:48.495278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:48.495740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:48.496426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:48.496873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:48.497294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:48.561680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:48.570054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d8f72137-5ae1-4e85-a4c0-ed2355570dfd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086161 Aug 22 16:29:48.570615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1103/2278] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:48.588593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:48.589216 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:48.596320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:48.596811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:48.597247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:48.597939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:48.598660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:48.599088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:48.659214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:48.666874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-70d63ebb-91cf-4551-bb94-337d285a42c5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082119 Aug 22 16:29:48.667457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1176/2279] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:48 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:48.674601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:48.675226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:48.681165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:48.681642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:48.682098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:48.682772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:48.683217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:48.683656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:48.809924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:48.818020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-13cfa2b6-4553-401b-9081-dbd201fbb465 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.147174 Aug 22 16:29:48.818586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1104/2280] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:48 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:49.592091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:49.592702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:49.599406 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:49.599889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:49.600322 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:49.601007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:49.601459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:49.601883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:49.663251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:49.671999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-344ec8f8-bfbe-4b44-aa8b-dd32bd687ca8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084323 Aug 22 16:29:49.672563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1177/2281] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:49.686414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:49.687032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:49.693670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:49.694153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:49.694589 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:49.695282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:49.695766 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:49.696190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:49.759532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:49.767319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b1b5098e-71f1-4a82-bcf4-e33ae6a6cd43 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084856 Aug 22 16:29:49.767909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1105/2282] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:49 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:49.839340 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:49.839980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:49.846542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:49.847024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:49.847487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:49.848170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:49.848884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:49.849304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:49.975718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:49.979071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:49.984841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e188e1fa-9bd6-4603-b9f1-7621b35e2427 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149306 Aug 22 16:29:49.985482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1178/2283] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:49 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:50.692139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:50.692750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:50.699530 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:50.700021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:50.700464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:50.701173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:50.701623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:50.702045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:50.768282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:50.776955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3db4ddfe-2e84-4ad3-9968-9f6d2aedb752 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088671 Aug 22 16:29:50.777550 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1106/2284] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:50.788670 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:50.789297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:50.797582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:50.797582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:50.798013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:50.798715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:50.799175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:50.799655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:50.866017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:50.874400 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3d0f286a-de26-484d-b79c-0bda35ae5940 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089784 Aug 22 16:29:50.874973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1179/2285] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:50 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:51.005628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:51.006243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:51.012279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:51.012763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:51.013200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:51.013925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:51.014412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:51.014839 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:51.141692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:51.149917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-657c53c0-f9e2-46bb-8ebc-dc9d032fe419 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.148162 Aug 22 16:29:51.150480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1107/2286] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:51 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:51.798426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:51.798971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:51.805398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:51.805879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:51.806320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:51.807021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:51.807534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:51.807966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:51.869217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:51.878051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a5717143-c5ea-43f2-bd9a-ecd67033225f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083699 Aug 22 16:29:51.878621 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1180/2287] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:51.894400 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:51.895012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:51.901499 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:51.901979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:51.902415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:51.903105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:51.903614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:51.904040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:51.964003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:51.971715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-95f313a0-f10c-4f08-8967-ed6273d69f27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081240 Aug 22 16:29:51.972289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1108/2288] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:51 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:52.171659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:52.172276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:52.178267 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:52.178739 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:52.179171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:52.179874 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:52.180326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:52.180745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:52.311635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:52.319832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fbc34cce-0956-46d2-9449-528e2ff0c42f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152533 Aug 22 16:29:52.320403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1181/2289] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:52 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:52.899778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:52.900395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:52.907569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:52.908079 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:52.908546 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:52.909244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:52.909695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:52.910125 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:52.972332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:52.981068 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f7355da5-85c2-43cc-a9e5-0e539ef98493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085047 Aug 22 16:29:52.981722 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1109/2290] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:52.992629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:52.993248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:52.999747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:53.000235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:53.000665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:53.001370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:53.001827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:53.002246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:53.067616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:53.076307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e9a628b4-30e2-4fdc-a893-c32753f42728 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087938 Aug 22 16:29:53.076907 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1182/2291] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:52 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:53.340623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:53.341240 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:53.347157 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:53.347664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:53.348096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:53.349044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:53.349492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:53.349911 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:53.477517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:53.486166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6ebc3ee6-53fc-45ea-a355-64025954c21e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149407 Aug 22 16:29:53.486731 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1110/2292] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:53 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:54.002945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:54.003626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:54.010184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:54.010668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:54.011112 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:54.011859 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:54.012318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:54.012742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:54.074275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:54.082583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0f274f2b-c7d0-4127-a2e5-f178e0b0c51f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083537 Aug 22 16:29:54.083138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1183/2293] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:54.097140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:54.097754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:54.104600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:54.105084 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:54.105517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:54.106841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:54.107294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:54.107744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:54.170920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:54.178885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fb2dbbb0-673f-4c1b-8dc9-d29d5c4ad137 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085491 Aug 22 16:29:54.179479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1111/2294] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:54 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:54.508373 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:54.508990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:54.515571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:54.516057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:54.516530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:54.517218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:54.517676 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:54.518099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:54.649474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:54.658220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-58e65fc6-9e50-4f1f-b71a-030ba922636b tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153676 Aug 22 16:29:54.658785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1184/2295] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:54 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:55.104723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:55.105367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:55.112643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:55.113131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:55.113568 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:55.114259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:55.114703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:55.115122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:55.176204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:55.185151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5a333092-4d2f-46fa-befc-8571a5b493dd tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084324 Aug 22 16:29:55.185724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1112/2296] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:55.199254 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:55.199927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:55.206346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:55.206849 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:55.207280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:55.208026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:55.208474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:55.208889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:55.328764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:55.336718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4e3dfd49-9b03-4376-9d09-f950e9eeb96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.141348 Aug 22 16:29:55.337290 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1185/2297] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:55 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:55.680329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:55.680932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:55.686885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:55.687383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:55.687816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:55.688491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:55.688934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:55.689346 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:55.693381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:55.820684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:55.829369 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fa9b96b8-c2dc-462e-b0fc-7ce5482c77dc tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152877 Aug 22 16:29:55.829934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1113/2298] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:55 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:56.205627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:56.206201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:56.212527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:56.212999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:56.213426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:56.214106 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:56.214548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:56.214963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:56.275883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:56.284140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c9965ab6-8db8-4a5e-84cb-5ed3576f9565 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082405 Aug 22 16:29:56.284702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1186/2299] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:56 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:56.356778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:56.357376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:56.363917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:56.364389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:56.364821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:56.365500 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:56.365944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:56.366358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:56.472375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:56.480377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-671c7dd7-916b-49fa-b4e1-64eb7b94c9ee tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.127463 Aug 22 16:29:56.480944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1114/2300] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:56 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:56.850964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:56.851594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:56.858092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:56.858566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:56.858999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:56.859701 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:56.860151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:56.860575 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:56.989280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:56.997513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-26d2462a-3105-4459-86a7-5207801b76fd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150653 Aug 22 16:29:56.998071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1187/2301] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:56 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:57.304900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:57.305456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:57.311513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:57.311991 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:57.312419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:57.313100 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:57.313545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:57.313962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:57.374042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:57.382150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-71d11b19-79bb-4619-98de-a51d41016781 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081345 Aug 22 16:29:57.382710 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1115/2302] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:57 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:29:57.501450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:57.502369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:57.508457 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:57.508938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:57.509364 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:57.510051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:57.510507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:57.510928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:57.576095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:57.584196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ea5c576a-6f4f-4489-bbc2-47f3e015a504 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086489 Aug 22 16:29:57.584775 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1188/2303] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:57 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:58.019234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:58.019787 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:58.025772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:58.026251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:58.026683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:58.027460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:58.027914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:58.028336 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:58.155800 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:58.163941 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c74fe152-6009-45c1-b67c-2002b27cecbe tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.148692 Aug 22 16:29:58.164508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1116/2304] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:58 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:58.403217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:58.403873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:58.410229 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:58.410700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:58.411130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:58.411844 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:58.412283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:58.412725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:58.476511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:58.485282 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9b128a8e-10a4-4a85-8024-8c3dda056c82 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085904 Aug 22 16:29:58.485854 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1189/2305] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:58 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:58.606242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:58.606867 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:58.613375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:58.613859 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:58.614286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:58.614969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:58.615448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:58.615874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:58.677058 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:58.684967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dd042e30-7b33-4c80-bda5-d60ddff9294c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083297 Aug 22 16:29:58.685532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1117/2306] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:58 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:59.185088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:59.185720 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:59.191753 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:59.192234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:59.192669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:59.193413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:59.193863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:59.194285 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:59.321673 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:59.330438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a5de5961-ddd3-412d-9150-aeda161c9b37 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.149715 Aug 22 16:29:59.331013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1190/2307] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:59 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:59.505998 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:59.506545 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:59.508434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=80 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:29:59.513746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:59.514222 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:59.514651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:59.515353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:59.515801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:59.516218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:59.578724 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:59.587156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-67e0128c-2ead-41b4-8138-26bd3742684c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085137 Aug 22 16:29:59.587778 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1118/2308] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:59 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:29:59.705936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:29:59.706537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:29:59.712896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:59.713371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:59.713804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:59.714480 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:29:59.715018 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:29:59.715979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:29:59.779755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:29:59.787539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bb96432d-64bf-484e-8132-0916fe6c5eda tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085418 Aug 22 16:29:59.788097 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1191/2309] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:29:59 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:00.352155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:00.352765 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:00.359172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:00.359681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:00.360115 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:00.360803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:00.361256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:00.361680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:00.497913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:00.506274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6c3c2454-d133-48e1-9c1f-4707d349cd73 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.158242 Aug 22 16:30:00.506872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1119/2310] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:00 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:00.608695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:00.609386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:00.611248 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=80 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:00.616447 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:00.616929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:00.617366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:00.618102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:00.618534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:00.618961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:00.679150 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:00.687834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3d227f73-df04-4a5b-a168-a7b306bc651d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083146 Aug 22 16:30:00.688393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1192/2311] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:00 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:00.808175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:00.809297 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:00.815211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:00.815725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:00.816163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:00.816851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:00.817305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:00.817735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:00.882652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:00.890946 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e6964b74-0951-46e3-9781-60f98d8f3488 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086743 Aug 22 16:30:00.891534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1120/2312] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:00 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:01.527309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:01.528374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:01.534748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:01.535228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:01.535700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:01.536392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:01.536851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:01.537274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:01.668713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:01.676914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-870eaa62-b467-4a90-ad32-4e07ce6e9052 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153515 Aug 22 16:30:01.677478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1193/2313] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:01 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:01.708961 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:01.709586 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:01.716473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:01.716956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:01.717393 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:01.718083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:01.718537 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:01.718958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:01.779866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:01.787987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e2783706-d4a2-4540-b397-3d89b054612a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083359 Aug 22 16:30:01.788547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1121/2314] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:01 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:01.911295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:01.911933 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:01.917828 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:01.918326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:01.918755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:01.919464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:01.919913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:01.920329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:01.980850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:01.988562 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-67c1921f-d95e-4c18-b3e2-12d7a1afd842 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081086 Aug 22 16:30:01.989118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1194/2315] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:01 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:02.698175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:02.698801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:02.705451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:02.705924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:02.706423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:02.707162 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:02.707669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:02.708092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:02.810886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:02.811563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:02.818390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:02.818879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:02.819317 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:02.820055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:02.820510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:02.820939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:02.841953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:02.856846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:02.874716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f2f9d72d-d70d-48aa-83c1-1b3f17f3738d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.180433 Aug 22 16:30:02.875309 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1122/2316] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:02 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:02.887504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:02.896065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e5120cb-03e4-4867-8bf3-b16bfe621596 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089939 Aug 22 16:30:02.896655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1195/2317] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:02 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:03.008510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:03.009040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:03.015043 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:03.015561 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:03.015996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:03.016682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:03.017132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:03.017553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:03.077436 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:03.085651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6a6b5432-19e8-434b-b2b3-573ed0d39c58 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081078 Aug 22 16:30:03.086218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1123/2318] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:03 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:03.895886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:03.896517 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:03.903546 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:03.904026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:03.904452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:03.905131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:03.905579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:03.905994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:03.916502 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:03.917144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:03.924234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:03.924725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:03.925164 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:03.925862 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:03.926340 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:03.926768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:04.002797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:04.011237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b69a12e7-0d89-433a-9292-78d01ea46d52 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.098511 Aug 22 16:30:04.012033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1124/2319] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:03 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:04.062847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:04.070971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-32c8f8db-2107-4413-8307-873e1a3760dd tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.178953 Aug 22 16:30:04.071554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1196/2320] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:03 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:04.105929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:04.106541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:04.112479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:04.112964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:04.113404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:04.114098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:04.114559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:04.114989 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:04.177037 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:04.184847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-47063fc3-3b5b-4f1d-8d88-df139d86d17e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082767 Aug 22 16:30:04.185420 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1125/2321] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:04 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:05.031249 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:05.032196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:05.039772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:05.040378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:05.041126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:05.042131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:05.042578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:05.043784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:05.092085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:05.092733 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:05.099613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:05.100103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:05.100683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:05.101292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:05.101969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:05.102571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:05.111371 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:05.119979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b42a961f-00af-417f-9ce7-a36564c3287a tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.092573 Aug 22 16:30:05.120573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1197/2322] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:05 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:05.205596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:05.206230 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:05.212636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:05.213129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:05.213571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:05.214297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:05.215268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:05.215732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:05.244210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:05.253062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e64bc722-38d0-47a7-9b5d-bfa46ab51b9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.164804 Aug 22 16:30:05.253652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1126/2323] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:05 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:05.280658 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:05.288800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d9331bfe-8acb-41aa-9815-6ed592daa760 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087057 Aug 22 16:30:05.289304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1198/2324] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:05 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:06.142376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:06.142996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:06.149415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:06.149900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:06.150328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:06.151020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:06.151492 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:06.151921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:06.213218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:06.221455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-aab8b5ee-2c26-4417-a365-6de2e037ab50 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082989 Aug 22 16:30:06.222025 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1127/2325] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:06 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:06.274102 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:06.274713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:06.281693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:06.282180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:06.282615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:06.283363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:06.283810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:06.284242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:06.311615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:06.312224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:06.318208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:06.318687 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:06.319117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:06.319831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:06.320279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:06.320695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:06.388533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:06.396622 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-116da436-bb13-4661-ac62-b48e1d105d54 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089663 Aug 22 16:30:06.397221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1128/2326] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:06 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:06.444005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:06.452534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-55468189-2a45-466e-b258-0457a82bb761 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.182369 Aug 22 16:30:06.453137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1199/2327] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:06 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:07.242640 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:07.243314 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:07.249684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:07.250168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:07.250601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:07.251302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:07.251779 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:07.252203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:07.315030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:07.318478 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:07.324533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7ed8f19f-9dab-4996-899c-85bf87821ce9 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085316 Aug 22 16:30:07.325123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1129/2328] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:07 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:07.416863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:07.417465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:07.424296 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:07.424780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:07.425218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:07.425910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:07.426368 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:07.426795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:07.486261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:07.486923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:07.492876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:07.493466 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:07.493944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:07.494377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:07.495081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:07.495563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:07.496541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:07.501270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e406f461-8dcb-4177-b0be-120b2ab49b0c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088237 Aug 22 16:30:07.501857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1200/2329] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:07 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:07.634419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:07.644026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5e335c27-54ab-4778-bcab-11ddb9cbc90f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161647 Aug 22 16:30:07.644609 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1130/2330] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:07 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:08.345921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:08.346573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:08.352819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:08.353299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:08.353733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:08.354414 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:08.354865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:08.355930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:08.416258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:08.425262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-591a9d61-94f9-4b8d-8801-94e4ce442a01 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083214 Aug 22 16:30:08.425883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1201/2331] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:08 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:08.524403 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:08.525011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:08.532142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:08.532619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:08.533052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:08.533776 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:08.534233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:08.534656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:08.598022 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:08.605931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-226879dc-a4fb-4699-9f6f-3a10a15d95c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085321 Aug 22 16:30:08.606491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1131/2332] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:08 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:08.665384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:08.666034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:08.672071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:08.672556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:08.673029 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:08.673727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:08.674184 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:08.674611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:08.807363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:08.815548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af7e2846-7e9c-4a91-a7b9-5c53d228d09f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154020 Aug 22 16:30:08.816125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1202/2333] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:08 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:09.445294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:09.445959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:09.452028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:09.452506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:09.452937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:09.453628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:09.454073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:09.454493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:09.519146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:09.527504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-afdd5c0c-b760-45a9-bc3b-ada8af6b54c2 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086002 Aug 22 16:30:09.528147 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1132/2334] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:09 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:09.627041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:09.627700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:09.634331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:09.634815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:09.635258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:09.635991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:09.636441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:09.636861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:09.698419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:09.706513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-db289471-b86e-4e89-8866-4e4e61d189c7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083415 Aug 22 16:30:09.707084 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1203/2335] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:09 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:09.837159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:09.837767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:09.844758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:09.845242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:09.845679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:09.846367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:09.846823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:09.847251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:09.986786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:10.001608 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1f5865a0-a277-4d3d-b2c6-5d76b2ac6128 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168027 Aug 22 16:30:10.002650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1133/2336] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:09 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:10.548161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:10.548801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:10.554757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:10.555240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:10.555705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:10.556397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:10.556850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:10.557273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:10.617793 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:10.626551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7b176b96-07f2-4431-92b3-0dd5c74bf81b tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082260 Aug 22 16:30:10.627114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1204/2337] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:10 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:10.727774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:10.728423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:10.734412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:10.734887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:10.735317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:10.736024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:10.736471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:10.736890 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:10.799159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:10.806858 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3033e82d-be71-4308-bc4d-c3d6f8fb4796 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083204 Aug 22 16:30:10.807437 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1134/2338] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:10 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:11.036994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:11.037610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:11.044668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:11.045151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:11.045588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:11.046279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:11.046816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:11.047193 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:11.179260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:11.188139 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0c7f924c-dd28-44d7-9803-adac000b9ac2 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155016 Aug 22 16:30:11.188719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1205/2339] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:11 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:11.647912 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:11.648433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:11.655505 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:11.655981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:11.656417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:11.657098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:11.657549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:11.657967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:11.718628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:11.727180 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-93029969-0f84-4f8b-826b-7c25f8c14910 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083200 Aug 22 16:30:11.727774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1135/2340] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:11 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:11.829550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:11.830164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:11.836300 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:11.836781 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:11.837219 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:11.837903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:11.838381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:11.838807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:11.899598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:11.907839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-205a22f0-56e3-44fa-b8a3-d234181b61cf tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083555 Aug 22 16:30:11.908399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1206/2341] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:11 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:12.209610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:12.210231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:12.216548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:12.217035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:12.217468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:12.218178 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:12.218638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:12.219064 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:12.351529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:12.360154 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8f0e09fd-54de-4fbf-bc71-037a36521bb7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154622 Aug 22 16:30:12.360716 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1136/2342] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:12 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:12.747247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:12.747895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:12.754321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:12.754807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:12.755246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:12.755970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:12.756428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:12.756857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:12.817430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:12.825863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-09af96d8-fbae-44e6-b15e-3fa1d0370e6c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082567 Aug 22 16:30:12.826478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1207/2343] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:12 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:12.928453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:12.929060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:12.935512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:12.935986 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:12.936413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:12.937092 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:12.937563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:12.937984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:12.998392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:13.006266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-68ba1bbc-fc8d-4967-b17d-75d6b4aa0bac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081661 Aug 22 16:30:13.006823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1137/2344] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:12 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:13.382937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:13.383564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:13.390026 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:13.390502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:13.390937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:13.391649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:13.392103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:13.392525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:13.526535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:13.534766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8f9f4575-b591-4e97-a4f2-438dd436b899 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.155671 Aug 22 16:30:13.535355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1208/2345] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:13 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:13.846630 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:13.847272 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:13.853614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:13.854093 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:13.854534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:13.855760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:13.856217 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:13.856643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:13.918161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:13.926480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d3ac9db7-7afd-4cf4-8cba-f40345745d77 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083684 Aug 22 16:30:13.927042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1138/2346] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:13 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:14.026135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:14.026743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:14.033161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:14.033636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:14.034066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:14.034751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:14.035197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:14.035642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:14.097162 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:14.105737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-635e11c5-398e-4655-b322-1c4e3ecc17b6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082925 Aug 22 16:30:14.106307 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1209/2347] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:14 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:14.556301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:14.556915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:14.563433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:14.563920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:14.564357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:14.565054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:14.565507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:14.565933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:14.705498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:14.718734 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7b32c2c4-f030-4837-a408-5b83117fcac0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.166250 Aug 22 16:30:14.721558 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1139/2348] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:14 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:14.947227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:14.947883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:14.955236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:14.955881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:14.956328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:14.957050 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:14.957515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:14.957944 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:15.030665 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:15.041203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aba535c0-90c1-45be-a0d5-5daf651a35dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.097945 Aug 22 16:30:15.041850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1210/2349] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:14 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:15.126969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:15.127649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:15.133954 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:15.134440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:15.134937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:15.135697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:15.136149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:15.137151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:15.204452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:15.212491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3d8b18b3-f772-4eb9-b892-ed8866b95cea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089537 Aug 22 16:30:15.213072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1140/2350] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:15 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:15.741837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:15.742458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:15.748510 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:15.749011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:15.749434 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:15.750125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:15.750582 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:15.751012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:15.881762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:15.889950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2d909acf-f2d6-4395-ab07-5e200b1082f9 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151987 Aug 22 16:30:15.890511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1211/2351] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:15 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:16.062340 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:16.062958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:16.069549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:16.070027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:16.070462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:16.071233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:16.071750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:16.072166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:16.133507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:16.142274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-73b87540-f41e-4f15-8423-511ff76db43d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083882 Aug 22 16:30:16.142875 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1141/2352] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:16 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:16.233700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:16.234313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:16.240731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:16.241211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:16.241645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:16.242328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:16.242783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:16.243209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:16.247157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:16.308637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:16.316351 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d994b4fe-70f9-4a30-80c6-e802387cec17 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086468 Aug 22 16:30:16.316912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1212/2353] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:16 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:16.911893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:16.912513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:16.919103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:16.919633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:16.920121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:16.920816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:16.921269 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:16.921694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:17.053823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:17.062668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-855e3913-1d53-465e-8f30-fba47a6f254d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.154689 Aug 22 16:30:17.063233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1142/2354] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:16 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:17.162958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:17.163425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:17.169987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:17.170466 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:17.170903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:17.171627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:17.172087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:17.172513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:17.241034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:17.249572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a5ca1257-dd67-4f2a-bd57-0dcbfba7f3d1 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.090637 Aug 22 16:30:17.250138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1213/2355] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:17 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:17.337753 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:17.338370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:17.345635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:17.346121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:17.346555 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:17.347260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:17.347742 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:17.348166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:17.416587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:17.426110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-291ad2c4-c52a-480c-ba00-41420aa68289 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092217 Aug 22 16:30:17.426695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1143/2356] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:17 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:18.083702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:18.084326 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:18.090485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:18.090970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:18.091452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:18.092150 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:18.092608 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:18.093036 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:18.222233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:18.230730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-86cdd4ad-6877-419e-a08d-9db880c7470d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150954 Aug 22 16:30:18.231304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1214/2357] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:18 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:18.269615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:18.270264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:18.276206 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:18.276693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:18.277127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:18.277814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:18.278273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:18.278698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:18.338744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:18.347122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7234c236-d41f-4791-8a12-5fffb2eac598 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.081421 Aug 22 16:30:18.347729 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1144/2358] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:18 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:18.446711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:18.447387 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:18.454017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:18.454506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:18.454948 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:18.455683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:18.456142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:18.456570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:18.520505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:18.528271 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ec6808fa-cd3e-4952-a643-ea64d41f5f2a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085445 Aug 22 16:30:18.528842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1215/2359] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:18 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:19.251797 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:19.252416 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:19.258394 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:19.258878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:19.259317 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:19.260035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:19.260490 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:19.260917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:19.368199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:19.368831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:19.374783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:19.375274 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:19.375750 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:19.376451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:19.376915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:19.377346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:19.395434 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:19.404337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8f5bf95a-48d4-4147-ab44-c2933a693c5f tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.156375 Aug 22 16:30:19.404915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1145/2360] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:19 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:19.440239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:19.449772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-33878b6a-0064-4025-b8c1-14cfdfa0e4ae tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084861 Aug 22 16:30:19.450462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1216/2361] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:19 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:19.548807 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:19.549412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:19.556258 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:19.556736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:19.557172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:19.557863 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:19.558852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:19.559271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:19.578366 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:19.623381 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:19.631074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9fd9d703-81ea-4ffe-a9bc-5a2a170fa22f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086121 Aug 22 16:30:19.631670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1146/2362] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:19 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:20.425679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:20.426405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:20.432941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:20.433425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:20.433864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:20.434555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:20.435013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:20.435475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:20.471476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:20.472112 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:20.478967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:20.479476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:20.480703 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:20.481391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:20.481842 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:20.482261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:20.564069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:20.586590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-54308330-c05f-4393-a32a-da64983c8ca4 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.118940 Aug 22 16:30:20.587188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1147/2363] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:20 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:20.613113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:20.624140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2b93ae3d-8a15-4e51-86c0-664bacc4a381 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.202380 Aug 22 16:30:20.625007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1217/2364] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:20 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:20.653046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:20.653653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:20.660175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:20.660663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:20.661094 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:20.661791 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:20.662241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:20.662662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:20.729024 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:20.738271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-371762d8-639a-44f7-bce7-08ab567bed39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089629 Aug 22 16:30:20.738846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1148/2365] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:20 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:21.608554 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:21.609175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:21.615686 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:21.616280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:21.616607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:21.617313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:21.619438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:21.619438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:21.646054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:21.646682 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:21.653460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:21.654038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:21.654552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:21.655320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:21.655872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:21.656389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:21.698441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:21.706725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bb5a468e-8009-41bd-82b8-47d599955012 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.102683 Aug 22 16:30:21.707306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1218/2366] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:21 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:21.757984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:21.758593 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:21.764614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:21.765096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:21.765530 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:21.766428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:21.766886 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:21.767309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:21.815273 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:21.823529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-552af8fe-a762-48af-a915-cecf9b4217f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.181287 Aug 22 16:30:21.824095 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1149/2367] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:21 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:21.831865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:21.840536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6c30fc9d-1ed8-452d-a162-a0879224cdb2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086316 Aug 22 16:30:21.841360 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1219/2368] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:21 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:22.729479 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:22.730035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:22.736446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:22.736929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:22.737367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:22.738062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:22.738513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:22.738940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:22.799522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:22.807701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a2f72bdd-3b4b-4b08-9c46-068246cfdbc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082265 Aug 22 16:30:22.808844 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1150/2369] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:22 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:22.843851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:22.844499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:22.851189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:22.851704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:22.852140 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:22.852830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:22.853287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:22.853713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:22.860879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:22.861488 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:22.867372 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:22.867854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:22.868282 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:22.868987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:22.869409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:22.869825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:22.953910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:22.961746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5f33e826-be79-4439-8db4-635735f2ff07 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.104621 Aug 22 16:30:22.962270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1151/2370] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:22 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:23.015482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:23.023796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d1550d9c-64e1-42c8-948d-7ad79c49bc9d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.183752 Aug 22 16:30:23.024349 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1220/2371] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:22 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:23.829688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:23.830301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:23.836736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:23.837214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:23.837644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:23.838327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:23.838774 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:23.839883 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:23.901354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:23.910182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-39919928-a2ea-46a8-be54-89070e96c8ad tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084383 Aug 22 16:30:23.910748 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1152/2372] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:23 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:23.982463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:23.983117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:23.989683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:23.990175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:23.990615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:23.991302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:23.991794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:23.992221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:24.044889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:24.045504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:24.051743 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:24.052261 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:24.052697 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:24.053389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:24.053908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:24.054331 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:24.057303 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:24.066714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2958c8d8-08fc-40a5-aced-67fbe9fbe69f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088045 Aug 22 16:30:24.068356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1221/2373] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:23 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:24.184837 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:24.194230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-43efa04a-8a4b-42f3-9833-d90a3c974096 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153217 Aug 22 16:30:24.194798 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1153/2374] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:24 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:24.931570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:24.932198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:24.939087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:24.939605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:24.940046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:24.940740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:24.941197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:24.941622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:25.004066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:25.013308 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0e38021c-c2fd-4a7b-8a72-dc65dc1d17c5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085784 Aug 22 16:30:25.013941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1222/2375] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:24 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:25.088487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:25.089102 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:25.096850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:25.097332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:25.097765 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:25.098752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:25.099193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:25.099643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:25.163480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:25.176705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-00cb7340-f289-4a22-bc5e-6da34075c7ff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092007 Aug 22 16:30:25.177291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1154/2376] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:25 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:25.219347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:25.220372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:25.229443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:25.230439 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:25.230875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:25.231601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:25.232075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:25.232496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:25.375824 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:25.388469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1315b883-58a5-4691-8332-a6eaf90b0503 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.175904 Aug 22 16:30:25.389157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1223/2377] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:25 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:26.034182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:26.034792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:26.040903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:26.041389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:26.041821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:26.042507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:26.042958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:26.043411 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:26.105526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:26.113745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-158a5e95-96fa-4e55-b271-93d1d15d1493 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083447 Aug 22 16:30:26.114311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1155/2378] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:26 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:26.199972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:26.200588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:26.207038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:26.207560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:26.207988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:26.208674 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:26.209116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:26.209534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:26.277309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:26.285111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-60bd0541-65a3-4d09-b696-19063048139d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091208 Aug 22 16:30:26.285612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1224/2379] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:26 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:26.409693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:26.410302 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:26.418439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:26.418856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:26.419284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:26.420002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:26.420447 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:26.420864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:26.558801 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:26.567233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fbf41acb-6dba-40e1-892e-5f34914a5136 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.161367 Aug 22 16:30:26.567919 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1156/2380] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:26 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:27.134392 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:27.135013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:27.141640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:27.142127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:27.142563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:27.143374 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:27.143860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:27.144287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:27.206598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:27.215462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6e6a19a2-4a23-499b-af18-e80c5ae8d184 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084995 Aug 22 16:30:27.216024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1225/2381] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:27 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:27.307257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:27.307257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:27.312529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:27.313018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:27.313452 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:27.314153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:27.314603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:27.315029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:27.378396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:27.386820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e52c3b9f-ecb2-48dd-9b0a-4f6ef999a59e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084605 Aug 22 16:30:27.387306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1157/2382] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:27 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:27.591570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:27.592180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:27.598702 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:27.599191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:27.599654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:27.600365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:27.600812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:27.601231 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:27.769061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:27.780679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b3cdc26e-95e9-4058-bfbd-c71c4cc09de7 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.194692 Aug 22 16:30:27.781337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1226/2383] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:27 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:28.240477 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:28.241593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:28.252002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:28.252843 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:28.253588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:28.254900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:28.255680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:28.256264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:28.324143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:28.333736 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bc63692c-4336-46d7-8947-a6cc7664640f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.099839 Aug 22 16:30:28.334472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1158/2384] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:28 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:28.406708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:28.407433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:28.413950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:28.414429 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:28.414862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:28.415615 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:28.416066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:28.416489 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:28.482935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:28.492578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-519c822b-c250-4d45-8a30-4e16abf95527 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089456 Aug 22 16:30:28.493175 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1227/2385] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:28 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:28.802670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:28.803198 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:28.809814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:28.810332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:28.810777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:28.811565 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:28.812018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:28.812433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:28.960049 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:28.969170 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-db585b1e-0450-46df-844f-d9a725ba9a74 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.170560 Aug 22 16:30:28.969755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1159/2386] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:28 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:29.356370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:29.356980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:29.363068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:29.363580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:29.364013 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:29.364705 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:29.365153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:29.365570 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:29.433607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:29.437523 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:29.443870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-260a8517-88c0-4e2d-9531-fa8346b566c7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091280 Aug 22 16:30:29.444472 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1228/2387] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:29 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:29.516397 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:29.517218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:29.519475 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=84 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:29.524745 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:29.525193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:29.525623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:29.526307 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:29.526752 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:29.527167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:29.593233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:29.601726 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d498775b-658a-40dc-a351-5b2fadf63651 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090897 Aug 22 16:30:29.602294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1160/2388] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:29 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:29.994081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:29.994711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:30.001394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:30.001889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:30.002496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:30.003218 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:30.003704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:30.004134 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:30.149433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:30.158857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8c345316-2a92-4e77-8b6a-fc63c67fbc79 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.169838 Aug 22 16:30:30.159454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1229/2389] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:29 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:30.466516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:30.467140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:30.473921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:30.474408 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:30.474840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:30.475584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:30.476038 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:30.476459 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:30.541641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:30.550367 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1f4413e7-15f3-4421-8177-6a4d64eb5854 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088327 Aug 22 16:30:30.550962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1161/2390] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:30 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:30.624062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:30.624695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:30.627086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=76 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:30.634332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:30.634821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:30.635255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:30.636539 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:30.636991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:30.637458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:30.704632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:30.712427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f9e50a55-ba80-421f-aa8f-d1600c3724af tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094022 Aug 22 16:30:30.712995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1230/2391] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:30 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:31.183937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:31.184555 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:31.190635 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:31.191113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:31.191588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:31.192277 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:31.192728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:31.193153 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:31.324507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:31.332826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-78da050e-60c3-49e1-8f5c-fbffa3b46711 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.153351 Aug 22 16:30:31.333396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1162/2392] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:31 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:31.570730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:31.571409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:31.577467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:31.577946 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:31.578381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:31.579089 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:31.579569 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:31.580005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:31.646877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:31.655800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b6852ef8-2eda-4e36-8c15-22b78fb73c9c tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.088945 Aug 22 16:30:31.656378 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1231/2393] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:31 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:31.734380 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:31.735028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:31.741526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:31.742007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:31.742484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:31.743176 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:31.743664 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:31.744091 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:31.748235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:31.807958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:31.815931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-85d1572c-1860-47a8-92a7-ef825f778fe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086133 Aug 22 16:30:31.816503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1163/2394] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:31 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:32.355275 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:32.355919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:32.362007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:32.362486 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:32.362919 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:32.363663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:32.364123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:32.364547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:32.516103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:32.524733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-942c9271-3832-47f2-bb9d-e7b579876d57 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.174133 Aug 22 16:30:32.525337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1232/2395] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:32 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:32.677246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:32.677886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:32.684066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:32.684555 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:32.684992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:32.685693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:32.686148 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:32.686583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:32.747948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:32.756260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8689e37a-95ee-4a03-9a9d-94abe5c5a5f6 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.082958 Aug 22 16:30:32.756832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1164/2396] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:32 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:32.837299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:32.837958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:32.845437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:32.845931 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:32.846367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:32.847228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:32.847742 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:32.848178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:32.921179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:32.929129 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ae56f289-33cf-4bdb-abb3-9cbe69df8283 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095562 Aug 22 16:30:32.929627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1233/2397] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:32 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:33.551906 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:33.552522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:33.559409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:33.559888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:33.560319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:33.561014 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:33.561461 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:33.561876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:33.717829 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:33.726732 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fbe7b31c-51d5-46c0-b37b-4984a921ed22 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.178668 Aug 22 16:30:33.727305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1165/2398] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:33 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:33.783077 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:33.783747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:33.789957 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:33.790372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:33.790810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:33.791557 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:33.792660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:33.793090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:33.857511 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:33.866214 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-26516e9d-1877-43f0-8048-1a4c02680f91 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087883 Aug 22 16:30:33.866796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1234/2399] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:33 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:33.952249 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:33.953279 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:33.961925 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:33.962514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:33.963026 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:33.964464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:33.964956 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:33.965387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:34.038183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:34.048838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c7a28035-da32-48a7-b277-83a651170b55 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.102440 Aug 22 16:30:34.049425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1166/2400] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:33 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:34.749041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:34.749659 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:34.756172 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:34.756666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:34.757107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:34.757830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:34.758292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:34.758719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:34.891383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:34.892017 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:34.898698 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:34.929816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:34.929816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:34.929816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:34.929816 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:34.931306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:34.931795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:34.931795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6ba1462d-ba93-4eb8-b9aa-56b56f7266d6 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.169127 Aug 22 16:30:34.931795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1235/2401] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:34 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:34.975141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:34.984062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-02cd1f6d-8d12-453a-a318-40dec96bbb83 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.097666 Aug 22 16:30:34.984620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1167/2402] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:34 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:35.069958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:35.070580 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:35.076723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:35.077209 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:35.077650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:35.078352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:35.078810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:35.079239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:35.144600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:35.152443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-36fad07c-dbfc-475f-a6c5-03bf8ff95b39 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086340 Aug 22 16:30:35.152959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1236/2403] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:35 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:35.941694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:35.942321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:35.949033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:35.949513 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:35.949943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:35.950628 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:35.951072 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:35.951531 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:36.005130 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:36.005897 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:36.013637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:36.014126 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:36.014561 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:36.015279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:36.015834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:36.016256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:36.094518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:36.103596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f1631d27-e7c8-476d-bf56-e2bfcc392eaf tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.102304 Aug 22 16:30:36.104183 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1237/2404] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:35 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:36.120894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:36.132717 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bdd40a0a-b847-472d-83cb-076e2e2b7a89 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.194119 Aug 22 16:30:36.133037 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1168/2405] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:35 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:36.173251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:36.173861 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:36.179888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:36.180367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:36.180791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:36.181487 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:36.181936 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:36.182869 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:36.246906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:36.255259 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-939eb2ed-f526-4f1c-9272-03d85b41839c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086210 Aug 22 16:30:36.255878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1238/2406] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:36 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:37.125472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:37.126081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:37.132598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:37.133229 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:37.133510 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:37.134388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:37.134655 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:37.135109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:37.155227 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:37.155867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:37.162418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:37.162899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:37.163355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:37.164045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:37.164495 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:37.164914 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:37.202806 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:37.212835 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6a63bd74-b324-411f-ba42-f2dba51a2520 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.091233 Aug 22 16:30:37.213430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1169/2407] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:37 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:37.278584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:37.279203 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:37.285274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:37.285763 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:37.286201 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:37.286903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:37.287377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:37.287811 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:37.306247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:37.315397 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f4cb539-be22-4d45-b498-10a1627aa362 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.164667 Aug 22 16:30:37.315984 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1239/2408] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:37 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:37.357634 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:37.366101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57f1ad8b-8788-462e-9a0a-7f6452a19c51 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091974 Aug 22 16:30:37.366686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1170/2409] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:37 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:38.234708 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:38.235318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:38.241928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:38.242405 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:38.242831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:38.243563 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:38.244014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:38.244433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:38.309240 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:38.317636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c4ef38be-4015-473d-9191-3908df06948d tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.086696 Aug 22 16:30:38.318221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1240/2410] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:38 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:38.337444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:38.337951 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:38.344953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:38.345424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:38.345854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:38.346552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:38.347000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:38.347449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:38.386577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:38.387199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:38.393625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:38.394119 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:38.394560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:38.395270 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:38.395758 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:38.396191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:38.495415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:38.504794 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d09b4a9a-490f-412f-b8c5-65a4d95050d9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.121945 Aug 22 16:30:38.513541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1241/2411] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:38 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:38.549931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:38.559231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2dc29502-1c5e-4556-ae0a-207ce5a2857e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.225583 Aug 22 16:30:38.559886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1171/2412] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:38 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:39.340178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:39.340814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:39.347813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:39.348953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:39.349685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:39.350603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:39.351066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:39.351545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:39.415836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:39.424418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-49f67e64-8cb7-4bee-b8dc-f63a8ca3bff7 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089766 Aug 22 16:30:39.425031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1242/2413] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:39 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:39.525977 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:39.527219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:39.533892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:39.534384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:39.534824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:39.535559 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:39.536016 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:39.536462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:39.583462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:39.584242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:39.591228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:39.591669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:39.592109 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:39.592829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:39.593291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:39.593711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:39.605974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:39.613894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7b108d75-6401-4699-85e1-b693d333b1ab tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091759 Aug 22 16:30:39.614472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1172/2414] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:39 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:39.735167 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:39.745830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a82f290f-6977-4179-9bf8-8b4d6c1a2521 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168740 Aug 22 16:30:39.746418 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1243/2415] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:39 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:40.445735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:40.446340 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:40.452438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:40.452910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:40.453338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:40.454019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:40.454465 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:40.454886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:40.520104 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:40.528959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f23067ca-7f42-4412-bca8-c5221f08c795 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087088 Aug 22 16:30:40.529556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1173/2416] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:40 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:40.634226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:40.634838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:40.641521 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:40.642000 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:40.642432 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:40.643125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:40.643609 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:40.644030 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:40.715494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:40.723821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bae47fae-c5ff-4c6d-bb7d-1c52cb62e30b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093127 Aug 22 16:30:40.724393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1244/2417] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:40 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:40.766190 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:40.766795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:40.773263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:40.773730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:40.774155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:40.774840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:40.775283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:40.775725 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:40.914848 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:40.925596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e5c14edd-99ff-4104-9e69-d6e1d9c2dccf tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.163276 Aug 22 16:30:40.926368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1174/2418] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:40 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:41.550796 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:41.551745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:41.558809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:41.559310 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:41.559818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:41.560553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:41.561104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:41.561697 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:41.581970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:41.633463 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:41.645455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e0a44de0-4452-4f95-9b61-ad5cf996d771 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.098819 Aug 22 16:30:41.646401 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1245/2419] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:41 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:41.746649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:41.747193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:41.756738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:41.757226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:41.757656 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:41.758385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:41.758846 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:41.759266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:41.828076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:41.836929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bed497fe-48e2-4ccf-a8b2-4b7b6031555e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094809 Aug 22 16:30:41.837448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1175/2420] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:41 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:41.948233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:41.948950 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:41.955551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:41.956035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:41.956467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:41.957173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:41.957624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:41.958051 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:42.111143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:42.120390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-59effd06-2f26-482e-a5f2-72ba355580ba tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.177000 Aug 22 16:30:42.120979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1246/2421] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:41 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:42.666232 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:42.666918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:42.676081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:42.676939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:42.677620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:42.678857 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:42.679566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:42.680288 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:42.749044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:42.757617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c625229c-37cc-4753-bb9e-1705bf657b14 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.095345 Aug 22 16:30:42.758195 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1176/2422] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:42 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:42.858262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:42.858882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:42.866011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:42.866544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:42.867110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:42.867889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:42.868352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:42.868772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:42.936508 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:42.945446 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c299a84c-c441-4448-a5fc-34f7193456c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091109 Aug 22 16:30:42.946023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1247/2423] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:42 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:43.140768 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:43.141425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:43.148679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:43.149172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:43.149606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:43.150337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:43.150772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:43.151196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:43.309562 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:43.318032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-10ab979f-68d1-4b79-820a-a0291411d34c tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.181349 Aug 22 16:30:43.318606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1177/2424] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:43 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:43.779834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:43.780451 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:43.786458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:43.786937 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:43.787393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:43.788088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:43.788532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:43.788959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:43.854277 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:43.863111 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9ac96a4b-2179-4f84-93d0-95f25f95dd20 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087604 Aug 22 16:30:43.863776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1248/2425] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:43 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:43.969410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:43.970044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:43.976508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:43.976994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:43.977440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:43.978135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:43.978582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:43.979046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:44.045133 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:44.053428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7f92d62e-ec51-4e2b-9351-6895d7c1278a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091159 Aug 22 16:30:44.054301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1178/2426] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:43 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:44.338646 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:44.339369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:44.345955 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:44.346441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:44.346881 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:44.347596 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:44.348074 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:44.348748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:44.728187 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:44.744244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ebeb5db3-f229-4489-a795-d57883977bdb tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.409363 Aug 22 16:30:44.745081 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1249/2427] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:44 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:44.884647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:44.885338 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:44.893638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:44.894152 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:44.894596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:44.895289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:44.895879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:44.896298 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:44.960462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:44.964418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:44.970141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9d7e0b96-be31-4d70-9714-b85d9fb42d03 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089429 Aug 22 16:30:44.970706 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1179/2428] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:44 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:45.075169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:45.075945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:45.082503 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:45.083003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:45.083537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:45.084568 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:45.084731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:45.085164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:45.153728 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:45.162474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f235f15c-ac06-4ac8-a868-aa5ac7142e6e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091846 Aug 22 16:30:45.163281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1250/2429] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:45 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:45.766213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:45.766827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:45.773301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:45.773782 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:45.774218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:45.774917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:45.775391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:45.776347 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:45.910535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:45.919828 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3f66d13d-4d37-4817-8a1d-cd978781cfd8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.157390 Aug 22 16:30:45.920421 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1180/2430] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:45 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:45.992284 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:45.992903 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:45.999685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:46.000190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:46.000636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:46.001344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:46.001973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:46.002411 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:46.067811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:46.077755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-28694fe3-5f37-4f52-8c26-5ac1d1c70b70 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.089477 Aug 22 16:30:46.078444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1251/2431] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:45 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:46.183069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:46.183666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:46.190142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:46.190637 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:46.191065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:46.191873 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:46.192326 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:46.192746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:46.256470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:46.265211 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-85dc74a0-559a-4f37-9530-27097ae7547c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086077 Aug 22 16:30:46.265821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1181/2432] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:46 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:46.941236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:46.941857 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:46.948572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:46.949060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:46.949514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:46.950196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:46.950660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:46.951088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:47.089041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:47.098334 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7959971b-8e65-4da8-8680-f04a69efe0b8 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.160940 Aug 22 16:30:47.100516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:47.101145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:47.109611 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:47.110212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:47.110625 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:47.110818 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1252/2433] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:46 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:47.111353 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:47.111851 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:47.112278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:47.183130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:47.191767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-99f5a2e8-19a2-4c79-baca-8cefe13000b5 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.096224 Aug 22 16:30:47.192600 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1182/2434] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:47 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:47.286529 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:47.287255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:47.294228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:47.294714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:47.295212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:47.296045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:47.296556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:47.296986 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:47.360773 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:47.368769 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-df315b0a-ce7e-4442-ab16-3177ce12b607 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086414 Aug 22 16:30:47.369598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1253/2435] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:47 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:48.120399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:48.121120 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:48.127802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:48.128283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:48.128715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:48.129406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:48.129855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:48.130278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:48.214934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:48.216474 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:48.224637 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:48.225433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:48.226124 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:48.227091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:48.227685 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:48.228196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:48.304059 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:48.305770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:48.313081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5d94a5d1-c279-481b-9bf4-e6b5845bb2f3 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.196957 Aug 22 16:30:48.313897 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1183/2436] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:48 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:48.314497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-41908285-9f60-45ff-8f73-cf703d5f4f8f tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.105088 Aug 22 16:30:48.315280 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1254/2437] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:48 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:48.390231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:48.390882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:48.397587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:48.398078 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:48.398520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:48.399231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:48.399715 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:48.400143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:48.466425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:48.474638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-14030b04-316d-47c4-88f6-b0215bde17ae tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088403 Aug 22 16:30:48.475210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1184/2438] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:48 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:49.335173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:49.335738 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:49.336086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:49.336168 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:49.343006 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:49.343145 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:49.343512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:49.343604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:49.343943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:49.344042 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:49.344626 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:49.344725 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:49.345069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:49.345149 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:49.345486 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:49.345585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:49.429156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:49.438173 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-33f3e6c8-4979-4d42-99be-c013c3b97dfb tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.106358 Aug 22 16:30:49.438777 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1185/2439] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:49 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:49.493993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:49.495103 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:49.501101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:49.501588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:49.501749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:49.502045 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:49.502746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:49.503196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:49.503693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:49.511176 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-02d21054-8e42-4227-9dc7-6df7538dd27d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.179839 Aug 22 16:30:49.511790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1255/2440] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:49 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:49.566601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:49.575293 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-df2b9045-7ae9-40c3-8533-53500bfcea33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085101 Aug 22 16:30:49.575974 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1186/2441] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:49 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:50.459639 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:50.460286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:50.466748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:50.467226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:50.467691 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:50.468384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:50.468836 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:50.469257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:50.530583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:50.532639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:50.533243 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:50.539174 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c16a9d81-f515-4d83-90fc-6cdfb21fbfc8 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083387 Aug 22 16:30:50.539455 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:50.539785 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1256/2442] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:50 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:50.539939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:50.540623 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:50.541042 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:50.542002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:50.542420 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:50.595878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:50.596496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:50.602768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:50.603257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:50.604244 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:50.604935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:50.605394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:50.605821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:50.678876 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:50.687583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-29127eaf-7814-4936-9c85-2325b6b9dcd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095562 Aug 22 16:30:50.688163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1257/2443] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:50 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:50.703615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:50.713363 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0ab26e2f-3ce0-4b37-aca5-657eaa23d877 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.185137 Aug 22 16:30:50.713864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1187/2444] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:50 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:51.563699 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:51.564328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:51.571213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:51.571734 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:51.572168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:51.573391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:51.573879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:51.574305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:51.638763 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:51.646911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7a5abfd0-b7f5-4e61-91b9-dd9c93c1ade3 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.087273 Aug 22 16:30:51.647504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1258/2445] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:51 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:51.713986 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:51.714624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:51.721128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:51.721613 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:51.722048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:51.722740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:51.723192 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:51.723920 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:51.733837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:51.734440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:51.740356 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:51.740827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:51.741256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:51.741963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:51.742415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:51.742831 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:51.797182 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:51.805489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e7ccd248-04d4-46ca-a87f-e44b67ab0082 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095265 Aug 22 16:30:51.806091 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1188/2446] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:51 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:51.890232 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:51.898965 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fd54baca-1043-4b4a-9f8f-0a81417a8d4e tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.168837 Aug 22 16:30:51.899592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1259/2447] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:51 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:52.199295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:30:52.199512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:30:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:30:52.667410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:52.668035 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:52.673969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:52.674445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:52.674880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:52.675591 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:52.676047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:52.676480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:52.739624 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:52.748404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3c6d56be-cc8c-4108-81b4-e05bdfc00ed0 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084941 Aug 22 16:30:52.748979 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1189/2448] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:52 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:52.826107 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:52.826716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:52.833164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:52.833643 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:52.834075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:52.834755 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:52.835203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:52.835645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:52.896048 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:52.903835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c722231b-7884-4420-a556-247bfb20c220 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081462 Aug 22 16:30:52.904391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1260/2449] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:52 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:30:52.920650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:52.921252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:52.927175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:52.927679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:52.928106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:52.928788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:52.929234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:52.929650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:53.058757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:53.066872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-64797f72-f1b8-4b74-864b-c1908da0d0d0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.150584 Aug 22 16:30:53.067448 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1190/2450] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:52 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:53.188669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:30:53.188835 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:30:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:30:53.769883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:53.770504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:53.777226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:53.777715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:53.778154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:53.778841 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:53.779293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:53.779736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:53.843033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:53.851595 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3b42d27f-56e6-46ba-9e20-c72fb944af39 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.085664 Aug 22 16:30:53.852154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1261/2451] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:53 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:53.925808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:53.926536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:53.933632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:53.934150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:53.934694 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:53.935213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:53.935692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:53.936111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:53.998975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:54.006679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-060a8dae-46e2-40c0-8873-1c77ad10fd27 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084696 Aug 22 16:30:54.007244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1191/2452] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:53 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:54.087830 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:54.088959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:54.095117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:54.095602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:54.096046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:54.096745 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:54.097204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:54.097634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:54.101852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:30:54.227350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:54.235994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2fc01c1c-4790-43af-bd02-5e65278075c0 tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.152038 Aug 22 16:30:54.236553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1262/2453] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:54 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:54.534676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:30:54.534834 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:30:54.872854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:54.873472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:54.879464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:54.879939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:54.880371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:54.881053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:54.881497 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:54.881918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:54.943525 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:54.953001 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-863030b8-53d9-4a4a-b763-f3e2e6594e58 tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.084847 Aug 22 16:30:54.953657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1192/2454] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:54 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:55.027597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:55.028215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:55.034683 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:55.035168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:55.035649 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:55.036515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:55.036979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:55.037413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:55.101438 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:55.109721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6eeaa2da-3da8-4fad-8489-55421df6711f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086038 Aug 22 16:30:55.110279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1263/2455] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:55 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:55.259145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:55.259795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] [instance: 8bb9f058-ee33-4a96-be12-be17f5ad3204] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:55.265740 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:55.266224 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:55.266660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:55.267376 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:55.267827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:55.268276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:55.396360 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a423ada4f24a8aae812a2495771383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cd9041298e400496762808cf2880eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:55.405262 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5cb3802e-2e5b-4a30-80f0-1226120b042d tempest-VolumesSnapshotTestJSON-51583296 tempest-VolumesSnapshotTestJSON-51583296-project] 10.222.0.40 "GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204" status: 200 len: 1560 microversion: 2.1 time: 0.151421 Aug 22 16:30:55.405826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1193/2456] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:55 2022] GET /compute/v2.1/servers/8bb9f058-ee33-4a96-be12-be17f5ad3204 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:55.974141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:55.974754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] [instance: 11a2bdd7-2790-42d9-914e-4dab6caaec39] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:55.981492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:55.981966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:55.982395 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:55.983068 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:55.983542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:55.983960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:56.044906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a379a0d6d7ef4453a10b4727cf19eb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f48363627d49948f567e5dd81e873a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:56.053228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-baab8ec7-ea15-4047-b164-eb22bafde23e tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39" status: 200 len: 1390 microversion: 2.1 time: 0.083248 Aug 22 16:30:56.053795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1264/2457] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:55 2022] GET /compute/v2.1/servers/11a2bdd7-2790-42d9-914e-4dab6caaec39 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:56.073368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-26a68bc7-ac40-4552-97bd-b163cc0838dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] Calling method '.version_select at 0x7feca025fca0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:56.096056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-26a68bc7-ac40-4552-97bd-b163cc0838dc tempest-TestMinimumBasicScenario-70130478 tempest-TestMinimumBasicScenario-70130478-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1393520262" status: 202 len: 0 microversion: 2.1 time: 0.026400 Aug 22 16:30:56.096620 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1194/2458] 10.222.0.40 () {58 vars in 1272 bytes} [Mon Aug 22 16:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1393520262 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:30:56.131448 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:56.132011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:56.138038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:56.138524 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:56.138959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:56.139825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:56.140283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:56.140709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:56.205738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:56.214246 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9e290e23-b080-4e65-ac9f-ec09f3ba446b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086917 Aug 22 16:30:56.214810 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1265/2459] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:56 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:57.234226 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:57.234833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:57.241764 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:57.242239 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:57.242668 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:57.243377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:57.243824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:57.244749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:57.333931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:57.341519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cf66d8be-c0bf-443a-aee2-62baa5607e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.111318 Aug 22 16:30:57.342083 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1195/2460] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:57 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:58.362332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:58.362947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:58.368988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:58.369502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:58.369935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:58.370626 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:58.371079 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:58.371536 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:58.437935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:58.446066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-82516461-de24-4a26-a69d-bb5e18b6f2e9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087933 Aug 22 16:30:58.446930 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1266/2461] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:58 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:30:59.032424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-2bfdc18a-c3ce-48c2-b4df-4d43948c026a req-24698505-40a9-437a-b3d6-d288f94fb0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb9f058-ee33-4a96-be12-be17f5ad3204", "name": "network-vif-deleted", "tag": "7a0e4b26-ea80-4f67-a130-a25e80b02fe5"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:30:59.046866 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2bfdc18a-c3ce-48c2-b4df-4d43948c026a req-24698505-40a9-437a-b3d6-d288f94fb0ab service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:59.047362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2bfdc18a-c3ce-48c2-b4df-4d43948c026a req-24698505-40a9-437a-b3d6-d288f94fb0ab service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:59.047786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2bfdc18a-c3ce-48c2-b4df-4d43948c026a req-24698505-40a9-437a-b3d6-d288f94fb0ab service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:59.061132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-2bfdc18a-c3ce-48c2-b4df-4d43948c026a req-24698505-40a9-437a-b3d6-d288f94fb0ab service nova] Creating event network-vif-deleted:7a0e4b26-ea80-4f67-a130-a25e80b02fe5 for instance 8bb9f058-ee33-4a96-be12-be17f5ad3204 on hv-cinder-85400 Aug 22 16:30:59.067923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-2bfdc18a-c3ce-48c2-b4df-4d43948c026a req-24698505-40a9-437a-b3d6-d288f94fb0ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039039 Aug 22 16:30:59.070029 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1196/2462] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:30:59.467321 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:30:59.468041 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:30:59.474430 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:59.474991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:59.475369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:59.476082 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:30:59.476704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:30:59.477132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:30:59.544518 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:30:59.552687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3149efce-e150-49c5-a50a-b4d696833cd5 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089168 Aug 22 16:30:59.553278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1267/2463] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:30:59 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:00.575831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:00.576554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:00.579138 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:31:00.584274 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:00.584762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:00.585196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:00.585902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:00.586352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:00.586775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:00.658333 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:00.666541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7ee809d3-eacd-46b2-a39a-795476546c06 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095994 Aug 22 16:31:00.667207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1197/2464] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:00 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:01.687196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:01.687864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:01.690233 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=76 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:31:01.695692 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:01.696188 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:01.696655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:01.697363 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:01.697817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:01.698242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:01.761788 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:01.771650 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f8abf078-b6d0-45c1-adb0-be587644a03b tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087958 Aug 22 16:31:01.772343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1268/2465] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:01 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:02.793583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:02.794361 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:02.803881 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:02.804515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:02.805107 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:02.805812 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:02.806264 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:02.807345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:02.811918 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:31:02.881781 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:02.891552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9a488be3-6fcb-45cc-abe1-cfc28bd62f1e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.101974 Aug 22 16:31:02.891878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1198/2466] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:02 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:03.911924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:03.912555 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:03.919011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:03.919535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:03.919973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:03.920671 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:03.921123 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:03.921549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:03.983850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:03.991837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eea4693c-fbf8-4c85-b415-a930e1017dd9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083833 Aug 22 16:31:03.992416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1269/2467] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:03 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:05.014342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:05.014899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:05.021335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:05.021814 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:05.022253 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:05.022942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:05.023426 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:05.023852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:05.090567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:05.099004 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-93061d00-f733-4502-af62-c2720098ffe2 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089103 Aug 22 16:31:05.099596 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1199/2468] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:05 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:06.119531 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:06.120171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:06.126583 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:06.127058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:06.127527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:06.128211 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:06.128660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:06.129085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:06.191960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:06.200425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8e3b1b78-ba84-42d6-a483-f697daca9d56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084675 Aug 22 16:31:06.201020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1270/2469] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:06 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:07.221482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:07.222106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:07.229329 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:07.229803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:07.230234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:07.230915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:07.231391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:07.231818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:07.292163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:07.299760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ea3338bc-8c96-41de-8d66-d2cca28e46d0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082122 Aug 22 16:31:07.300320 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1200/2470] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:07 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:08.323929 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:08.324565 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:08.331127 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:08.331654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:08.332098 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:08.332819 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:08.333281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:08.333709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:08.399832 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:08.407813 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b28a1efb-5704-4637-9d3c-bac1cef25b2c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089648 Aug 22 16:31:08.408384 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1271/2471] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:08 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:09.428865 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:09.429391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:09.435971 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:09.436454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:09.436900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:09.437588 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:09.438046 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:09.438472 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:09.504144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:09.512945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-caa7dfe6-fae1-4945-97f9-7441376862b1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087977 Aug 22 16:31:09.513521 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1201/2472] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:09 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:10.533994 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:10.534616 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:10.541532 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:10.542023 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:10.542462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:10.543196 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:10.543682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:10.544114 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:10.607066 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:10.614873 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3b7c56b8-ccd0-4d9f-be2d-9238fbb5db8f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084739 Aug 22 16:31:10.615464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1272/2473] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:10 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:11.635942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:11.636526 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:11.642936 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:11.643449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:11.643889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:11.644578 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:11.645034 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:11.645462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:11.706735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:11.714644 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d24da8b8-2b5e-417b-a650-259f0cbb7cd7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082747 Aug 22 16:31:11.715204 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1202/2474] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:11 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:12.735171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:12.735817 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:12.742169 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:12.742647 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:12.743083 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:12.743806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:12.744263 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:12.744684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:12.806574 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:12.814226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dcf14768-efeb-4843-9755-def04ecd2767 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082961 Aug 22 16:31:12.814791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1273/2475] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:12 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:13.834371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:13.835000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:13.842105 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:13.842577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:13.842999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:13.843702 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:13.844150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:13.844563 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:13.907535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:13.915187 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5180e3ff-9d9b-4cc0-84f1-8acf75be9b7e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084653 Aug 22 16:31:13.915955 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1203/2476] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:13 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:14.936619 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:14.937146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:14.943648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:14.944128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:14.944564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:14.945256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:14.945709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:14.946133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:15.017885 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:15.031262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dd602cda-c36b-4f82-bd3d-f1ee56d8237e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.098215 Aug 22 16:31:15.032309 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1274/2477] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:14 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:16.061020 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:16.061889 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:16.068276 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:16.068823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:16.069305 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:16.070140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:16.070638 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:16.071109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:16.137390 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:16.145442 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4304b01a-285e-46ac-9d80-27de7a18b019 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088265 Aug 22 16:31:16.146021 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1204/2478] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:16 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:31:17.180142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:17.180764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:17.188191 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:17.188706 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:17.189141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:17.189845 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:17.190298 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:17.190723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:17.255634 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:17.264544 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16a79e48-f566-40c8-b86d-9f7fae2c4ed0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088217 Aug 22 16:31:17.265137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1275/2479] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:17 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:31:18.285847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:18.286709 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:18.294627 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:18.295252 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:18.295754 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:18.296471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:18.296921 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:18.297345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:18.367370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:18.375915 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c116c309-5134-47e8-bd14-f9216e40a55c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094142 Aug 22 16:31:18.376573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1205/2480] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:18 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:19.398952 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:19.399680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:19.406928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:19.407502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:19.408070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:19.408926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:19.409496 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:19.409959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:19.481770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:19.491589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-50b1ddcb-bfc2-41b5-8843-029bcf773e33 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.096980 Aug 22 16:31:19.492194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1276/2481] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:19 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:20.516234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:20.517098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:20.524815 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:20.525509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:20.526076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:20.526795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:20.527355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:20.527853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:20.600401 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:20.610345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5cff1295-4222-4f64-bbc8-9b63b837ad38 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.098572 Aug 22 16:31:20.611167 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1206/2482] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:20 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:21.644251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:21.644927 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:21.653840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:21.654445 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:21.655022 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:21.655892 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:21.656600 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:21.657179 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:21.743092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:21.752743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-484fca3a-d6bf-4a74-8c72-b9bf52d1bece tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.112701 Aug 22 16:31:21.753494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1277/2483] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:21 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:31:22.784517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:22.785159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:22.793553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:22.794007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:22.794487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:22.795260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:22.795871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:22.796378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:22.869877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:22.878669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0146c12b-03a1-4b8b-8422-08c432adf74c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.098048 Aug 22 16:31:22.879552 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1207/2484] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:22 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:31:23.901210 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:23.901838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:23.909161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:23.909663 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:23.910105 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:23.910953 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:23.911618 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:23.912058 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:23.982024 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:23.985713 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:31:23.990978 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eb81e805-1bc0-439e-ba2e-0c43c352d568 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093905 Aug 22 16:31:23.991589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1278/2485] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:23 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:31:25.012878 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:25.013538 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:25.021870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:25.022618 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:25.023256 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:25.024356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:25.024965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:25.025507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:25.107937 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:25.116901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ebe51e36-348e-47e8-8210-1824e8a42752 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.108385 Aug 22 16:31:25.117549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1208/2486] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:25 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:26.141060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:26.141768 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:26.149095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:26.150344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:26.150956 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:26.151867 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:26.152477 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:26.152940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:26.231839 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:26.240115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9fd53d3a-81f2-45e3-b75a-9fcbeba72a21 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.103279 Aug 22 16:31:26.240687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1279/2487] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:26 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:27.263823 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:27.264440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:27.270993 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:27.271571 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:27.272002 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:27.272683 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:27.273130 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:27.273547 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:27.340172 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:27.347962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e9dfe7cc-e93a-4ace-8d1d-db38e2741473 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089048 Aug 22 16:31:27.348825 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1209/2488] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:27 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:28.369515 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:28.370131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:28.376579 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:28.377061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:28.377498 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:28.378205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:28.378655 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:28.379086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:28.445009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:28.453827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a71677fa-7567-430b-bc03-f5d32be258ed tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088712 Aug 22 16:31:28.454439 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1280/2489] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:28 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:29.477395 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:29.478143 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:29.486323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:29.486855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:29.487303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:29.488237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:29.488713 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:29.489169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:29.553893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:29.563549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9f2844d6-b6f3-4ecb-a1b3-ba2e8551b0c0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091273 Aug 22 16:31:29.564349 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1210/2490] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:29 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:30.585991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:30.586597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:30.594454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:30.594964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:30.595436 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:30.596144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:30.596604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:30.597034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:30.664853 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:30.673062 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bf59018e-2c6c-44d6-a58f-f59b31d4e83e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090894 Aug 22 16:31:30.673642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1281/2491] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:30 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:31.697602 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:31.698227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:31.700759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=28 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:31:31.706491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:31.706973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:31.707431 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:31.708131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:31.708576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:31.709005 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:31.778939 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:31.786780 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b16fc1a6-ceb7-4c1a-a535-3e30508cc5a1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093407 Aug 22 16:31:31.787413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1211/2492] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:31 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:31:32.811851 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:32.812475 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:32.814947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=28 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:31:32.823299 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:32.823904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:32.824482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:32.825318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:32.825979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:32.826740 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:32.892031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:32.901940 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3d2be89d-338c-42c5-8387-40fecabc5efc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.097470 Aug 22 16:31:32.902598 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1282/2493] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:32 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:33.922090 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:33.922820 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:33.930522 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:33.931292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:33.931773 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:33.932485 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:33.932938 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:33.933371 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:33.936306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=83 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:31:34.016855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:34.026019 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ad2b360d-d4df-4311-8f3f-61e17d1e7ec8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.107626 Aug 22 16:31:34.026667 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1212/2494] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:33 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:35.048198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:35.048882 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:35.055318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:35.056358 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:35.056790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:35.057473 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:35.057921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:35.058336 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:35.121428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:35.129825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a3270e0b-06b3-4d6d-bb28-c3306d5e5530 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085398 Aug 22 16:31:35.130415 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1283/2495] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:35 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:36.152199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:36.152914 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:36.159755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:36.160267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:36.160761 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:36.161468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:36.162000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:36.162462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:36.234874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:36.242988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d916d2ba-31cb-4929-9feb-654a72f3b96f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095283 Aug 22 16:31:36.243599 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1213/2496] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:36 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:37.270202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:37.270846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:37.278871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:37.279556 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:37.280017 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:37.280889 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:37.281355 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:37.281969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:37.349225 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:37.359551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1f56c2a8-6506-45b1-a5b8-2bf33ae3b9c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093441 Aug 22 16:31:37.360492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1284/2497] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:37 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:38.393449 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:38.394070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:38.402123 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:38.402963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:38.403818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:38.405047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:38.405891 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:38.406650 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:38.477378 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:38.485684 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-65ff0ed6-d2b5-4046-818f-a5f84c0cd7e3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.096228 Aug 22 16:31:38.486259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1214/2498] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:38 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:39.507506 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:39.508141 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:39.515478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:39.515970 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:39.516402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:39.517157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:39.517614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:39.518040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:39.583379 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:39.591800 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dcb0ae7d-6c6e-49cd-80d4-8bf34aea45fd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088351 Aug 22 16:31:39.592366 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1285/2499] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:39 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:40.612899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:40.613540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:40.619904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:40.620377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:40.620808 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:40.621484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:40.621932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:40.622348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:40.684476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:40.692175 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-25b30578-6ac2-4844-b309-fdc07d864671 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083136 Aug 22 16:31:40.692739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1215/2500] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:40 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:41.713204 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:41.713714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:41.720158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:41.720635 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:41.721071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:41.721752 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:41.722199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:41.722620 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:41.784964 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:41.792644 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2eeea4f0-d18a-4689-adb0-2756e13b5e89 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084034 Aug 22 16:31:41.793198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1286/2501] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:41 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:42.812250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:42.812870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:42.819501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:42.819986 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:42.820423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:42.821705 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:42.822161 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:42.822584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:42.883121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:42.891433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3b2829c1-e5e5-406b-9da6-fed9f43e1198 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083018 Aug 22 16:31:42.891997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1216/2502] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:42 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:43.912053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:43.912677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:43.919264 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:43.919766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:43.920202 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:43.920884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:43.921338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:43.921759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:44.130104 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:44.138241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e1196501-11ef-4268-91a4-6c57e1c57a72 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.230024 Aug 22 16:31:44.138791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1287/2503] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:43 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:45.158663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:45.159266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:45.166501 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:45.167007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:45.167460 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:45.168150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:45.168598 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:45.169010 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:45.232345 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:45.239910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-03ba5d4e-4e93-4cbb-855e-2657beb3589f tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085157 Aug 22 16:31:45.240462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1217/2504] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:45 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:46.260297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:46.260905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:46.267297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:46.267803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:46.268258 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:46.268926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:46.269382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:46.269806 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:46.329991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:46.338235 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-287143d7-0b48-4479-aa46-080fb6e23533 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082295 Aug 22 16:31:46.338778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1288/2505] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:46 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:47.628303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:47.628982 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:47.634909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:47.635425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:47.635853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:47.636529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:47.636986 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:47.637398 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:47.698856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:47.706489 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b5383af7-75bd-4106-955f-0fa27a81422c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.351465 Aug 22 16:31:47.707052 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1218/2506] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:47 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:48.726409 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:48.727055 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:48.733514 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:48.733990 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:48.734424 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:48.735110 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:48.735592 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:48.736015 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:48.796072 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:48.803748 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-78fa9c75-8e26-457a-8432-48a98c77b4da tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081423 Aug 22 16:31:48.804304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1289/2507] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:48 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:49.825621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:49.826233 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:49.832712 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:49.833183 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:49.833615 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:49.834295 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:49.834735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:49.835150 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:49.906357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:49.914389 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bef25170-cba2-45e7-9c6b-653173dab8c1 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092495 Aug 22 16:31:49.914963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1219/2508] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:49 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:50.934711 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:50.935318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:50.941975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:50.942485 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:50.942915 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:50.943627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:50.944078 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:50.944497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:51.008032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:51.015941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-35a71c23-5941-4952-9b62-665642c2831a tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085076 Aug 22 16:31:51.016505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1290/2509] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:50 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:52.037003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:52.037619 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:52.044880 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:52.045365 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:52.045809 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:52.046509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:52.046962 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:52.047419 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:52.111641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:52.119686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-94e74db5-a274-4c32-ba17-8fb5a7148b9e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086485 Aug 22 16:31:52.120271 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1220/2510] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:52 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:53.139754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:53.140367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:53.147033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:53.147540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:53.147972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:53.148700 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:53.149168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:53.149589 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:53.213080 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:53.221545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ca1626f5-aac8-485e-aebb-81c071894abc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085734 Aug 22 16:31:53.222168 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1291/2511] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:53 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:54.242721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:54.243377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:54.250200 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:54.250680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:54.251110 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:54.251840 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:54.252283 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:54.252702 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:54.587960 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:54.597343 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a4215f6f-5c27-4c3c-9fd9-1c0fa0da6408 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.358887 Aug 22 16:31:54.597933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1221/2512] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:54 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:31:55.630367 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:55.630971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:55.639031 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:55.639682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:55.640221 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:55.641054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:55.641607 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:55.642132 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:55.728093 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:55.736999 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7f8d3ac-19a3-4ecf-b3e1-7ec0f2236e3c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.111258 Aug 22 16:31:55.737572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1292/2513] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:55 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:56.765933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:56.766543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:56.778671 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:56.779159 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:56.779641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:56.780351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:56.780805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:56.781234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:56.854767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:56.863514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-37d7e094-9af3-49ed-8059-8dd824770f75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.101469 Aug 22 16:31:56.864121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1222/2514] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:56 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:31:57.886945 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:57.887662 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:57.894099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:57.894581 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:57.895010 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:57.895736 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:57.896185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:57.896604 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:57.899509 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=85 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:31:57.966733 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:57.975018 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0a99a883-12bc-49d2-b70b-8784e9000091 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092463 Aug 22 16:31:57.975622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1293/2515] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:57 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:31:58.996651 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:31:58.997250 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:31:59.004088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:59.004566 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:59.004994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:59.005686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:31:59.006129 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:31:59.006574 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:31:59.076251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:31:59.084674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0da5385c-1133-48c3-a20e-77f6632b7456 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091842 Aug 22 16:31:59.085255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1223/2516] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:31:58 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:00.108456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:00.109101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:00.115926 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:00.116423 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:00.117009 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:00.117821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:00.118279 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:00.118731 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:00.190088 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:00.198746 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0aedb011-a425-4c20-baba-a17a9abbb593 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.094573 Aug 22 16:32:00.199345 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1294/2517] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:00 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:01.224757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:01.225947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:01.238368 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:01.239257 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:01.240098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:01.241422 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:01.242899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:01.243721 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:01.331440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:01.342581 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c03dec37-e2ed-4ea5-be4c-6a53f8175eff tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.125110 Aug 22 16:32:01.343541 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1224/2518] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:01 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:02.369790 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:02.370512 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:02.376980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:02.377467 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:02.377906 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:02.378603 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:02.379056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:02.379527 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:02.444623 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:02.455268 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-992dc1e6-42da-4e14-965d-fe651c2cef93 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089838 Aug 22 16:32:02.455877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1295/2519] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:02 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:03.477931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:03.478654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:03.481289 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=28 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:32:03.487352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:03.487903 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:03.488391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:03.489208 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:03.489739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:03.490251 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:03.556291 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:03.564234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c2b806cc-9689-4b60-ad62-7cd0e3b0a1a7 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091887 Aug 22 16:32:03.564832 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1225/2520] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:03 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:32:04.586100 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:04.586759 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:04.589197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=28 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:32:04.594792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:04.595273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:04.595727 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:04.596449 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:04.596895 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:04.597331 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:04.658963 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:04.667067 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ef79bc87-b3e9-4d97-84cd-6d0283c3ca01 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085617 Aug 22 16:32:04.667808 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1296/2521] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:04 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:05.688306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:05.688933 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:05.695507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:05.695992 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:05.696428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:05.697118 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:05.697572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:05.697996 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:05.700577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=84 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:32:05.765577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:05.773246 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-99f2705e-9882-41eb-85a1-8a73bf6d6d10 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088829 Aug 22 16:32:05.773813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1226/2522] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:05 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:06.794250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:06.794767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:06.801245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:06.801723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:06.802153 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:06.802840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:06.803292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:06.803741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:06.863962 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:06.872125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-894febeb-1b3c-474e-9507-5f6e666ba3be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081867 Aug 22 16:32:06.872689 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1297/2523] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:06 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:07.892805 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:07.893424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:07.900994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:07.901481 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:07.901949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:07.902657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:07.903116 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:07.903580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:08.126073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:08.134516 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1369e340-4b20-4390-aca7-2cf28c14fa23 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.245676 Aug 22 16:32:08.135082 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1227/2524] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:07 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:09.154975 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:09.155613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:09.162117 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:09.162594 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:09.163086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:09.164390 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:09.164865 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:09.165287 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:09.226540 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:09.234301 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ceac791a-b85f-4fe1-ac6e-88248ce22466 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083136 Aug 22 16:32:09.234862 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1298/2525] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:09 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:10.254189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:10.254727 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:10.261838 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:10.262328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:10.262735 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:10.263443 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:10.263942 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:10.264341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:10.324515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:10.332141 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-da6fcd20-7935-431a-8511-d3603081695d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.081872 Aug 22 16:32:10.332688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1228/2526] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:10 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:11.353724 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:11.354338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:11.360863 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:11.361344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:11.361779 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:11.362471 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:11.362924 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:11.363380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:11.426217 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:11.434020 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0982e4dd-48e4-4a45-99a2-ac925f268a77 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084788 Aug 22 16:32:11.434573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1299/2527] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:11 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:12.456056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:12.456868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:12.464543 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:12.465237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:12.465723 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:12.466570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:12.467069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:12.467606 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:12.541567 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:12.550854 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-98778362-5a89-498d-bf7a-fb9f44d3f993 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.099209 Aug 22 16:32:12.551450 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1229/2528] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:12 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:13.572834 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:13.573437 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:13.580094 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:13.580588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:13.581027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:13.581741 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:13.582203 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:13.582633 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:13.644522 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:13.652417 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7c5a1538-9e20-48c9-8f8d-ffabcbc43b66 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084069 Aug 22 16:32:13.652989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1300/2529] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:13 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:14.671943 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:14.672560 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:14.679109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:14.679641 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:14.680085 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:14.680795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:14.681254 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:14.681680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:14.748959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:14.757841 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-45700ecb-9ac9-4a77-b208-3915380d3da6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089219 Aug 22 16:32:14.758409 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1230/2530] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:14 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:15.779452 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:15.780226 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:15.786543 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:15.787027 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:15.787505 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:15.788245 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:15.788703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:15.789648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:15.855086 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:15.863422 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4bb393db-2770-4f37-b4e6-3b9ab6906f31 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087769 Aug 22 16:32:15.863998 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1301/2531] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:15 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:16.884234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:16.884850 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:16.891444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:16.891926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:16.892362 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:16.893057 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:16.893504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:16.893927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:16.957680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:16.965654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5e1ce2e0-6327-47ed-9932-d8604313fbbd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085374 Aug 22 16:32:16.966235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1231/2532] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:16 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:17.987629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:17.988237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:17.996846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:17.997332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:17.997764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:17.998459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:17.998912 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:17.999359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:18.063257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:18.072328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-748ec05f-5a4c-45ff-b417-0c3c32754316 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088517 Aug 22 16:32:18.072910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1302/2533] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:17 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:19.093235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:19.093913 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:19.100794 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:19.101292 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:19.101728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:19.102445 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:19.102895 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:19.103321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:19.165691 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:19.173470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-da59e69b-75ec-4750-8621-f1c9583768cd tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084264 Aug 22 16:32:19.174032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1232/2534] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:19 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:20.194012 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:20.195318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:20.201809 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:20.202283 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:20.202717 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:20.203442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:20.203887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:20.204305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:20.267045 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:20.274991 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1d576ac2-fd89-42ec-b8bc-7b974637d758 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084857 Aug 22 16:32:20.275597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1303/2535] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:20 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:21.296284 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:21.296892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:21.303453 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:21.303969 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:21.304405 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:21.305098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:21.305544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:21.305963 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:21.372940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:21.380680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5dbf95a9-8b8a-4bf1-b687-f63781e46a28 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.088331 Aug 22 16:32:21.381245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1233/2536] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:21 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:32:22.402003 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:22.402625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:22.409426 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:22.409910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:22.410347 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:22.411063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:22.411549 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:22.411971 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:22.474247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:22.482494 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e288c8d-2745-449d-9a2d-0f84e686220c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084444 Aug 22 16:32:22.483054 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1304/2537] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:22 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:23.503396 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:23.504009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:23.511113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:23.511631 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:23.512076 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:23.512821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:23.513285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:23.513711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:23.577934 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:23.585760 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-177bfd2c-ebc5-4a42-af74-60962d258e34 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086269 Aug 22 16:32:23.586494 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1234/2538] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:23 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:24.606679 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:24.607215 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:24.614225 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:24.614723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:24.615273 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:24.616458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:24.617346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:24.618234 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:24.686542 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:24.693588 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b4c2fa77-9a02-4803-a9e5-d804583abcaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090841 Aug 22 16:32:24.694710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1305/2539] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:24 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:25.717775 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:25.718388 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:25.725091 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:25.725576 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:25.726011 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:25.726695 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:25.727149 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:25.727601 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:25.791741 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:25.799364 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cb5bac2f-ec1f-45fa-a8fb-63acbf328ed6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085471 Aug 22 16:32:25.799927 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1235/2540] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:25 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:26.820399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:26.821047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:26.827578 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:26.828060 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:26.828497 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:26.829190 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:26.829653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:26.830075 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:26.893069 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:26.900966 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4f07c5b4-4db7-4d83-996b-f4e0924077ea tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084662 Aug 22 16:32:26.901545 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1306/2541] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:26 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:27.922131 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:27.922737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:27.929044 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:27.929529 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:27.929959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:27.930649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:27.931101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:27.931554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:28.000582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:28.008385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1fa96892-4fc3-4b32-abbf-c68a772095dc tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090084 Aug 22 16:32:28.008952 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1236/2542] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:27 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:29.028958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:29.029567 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:29.035860 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:29.036332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:29.036764 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:29.037443 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:29.038402 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:29.038822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:29.041455 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=84 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:32:29.101525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:29.109281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e3aa4f62-1cf5-4bd7-b0a5-306b965a4f59 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084166 Aug 22 16:32:29.109850 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1307/2543] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:29 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:30.130188 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:30.130790 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:30.137755 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:30.138227 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:30.138658 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:30.139348 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:30.139803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:30.140220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:30.203714 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:30.211423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6bfd4813-52c6-4019-a48b-f4b66d2d6ca3 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085040 Aug 22 16:32:30.211970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1237/2544] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:30 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:31.232714 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:31.233389 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:31.240687 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:31.241791 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:31.242239 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:31.242995 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:31.243504 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:31.243941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:31.316181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:31.324177 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b412e993-1474-421d-899f-24b072da8d44 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.095494 Aug 22 16:32:31.324751 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1308/2545] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:31 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:32.345140 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:32.345758 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:32.352792 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:32.353287 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:32.353730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:32.354438 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:32.354893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:32.355321 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:32.424491 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:32.432957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-98ae16e6-a87a-43b4-9d21-7257996f742c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091722 Aug 22 16:32:32.433518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1238/2546] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:32 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:33.455816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:33.456661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:33.463313 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:33.463858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:33.464293 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:33.464979 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:33.465431 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:33.465852 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:33.527146 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:33.534896 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-da506e8c-6484-49cd-9c0b-19b98001e788 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083050 Aug 22 16:32:33.535726 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1309/2547] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:33 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:34.557978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:34.558583 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:34.560908 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=28 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:32:34.566572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:34.567054 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:34.567527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:34.568241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:34.568739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:34.569285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:34.644504 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:34.652788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3acb4074-caee-47ac-b32e-68176cd62472 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.098585 Aug 22 16:32:34.653344 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1239/2548] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:34 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:35.674125 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:35.674846 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:35.677189 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=28 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:32:35.683040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:35.683553 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:35.683992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:35.684681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:35.685135 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:35.685560 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:35.747131 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:35.754837 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a4888bc7-9edc-4882-b670-0bb6ebfccee4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084555 Aug 22 16:32:35.755413 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1310/2549] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:35 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:36.776680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:36.777281 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:36.783783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:36.784260 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:36.784690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:36.785373 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:36.785818 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:36.786235 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:36.789473 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=84 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:32:36.850730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:36.858614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-412d6177-661d-4028-9132-e9573cb83a6c tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085886 Aug 22 16:32:36.859212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1240/2550] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:36 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:37.879922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:37.880535 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:37.887551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:37.888035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:37.888470 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:37.889164 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:37.889622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:37.890046 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:37.951878 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:37.960205 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e38ece88-cfea-4f69-93c9-b939b36836c6 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.083565 Aug 22 16:32:37.960776 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1311/2551] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:37 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:38.980967 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:38.981587 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:38.988088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:38.988570 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:38.988994 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:38.989676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:38.990117 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:38.991096 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:39.057018 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:39.064893 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2721c01d-c094-4141-8d7e-bc4beac3c418 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087758 Aug 22 16:32:39.065464 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1241/2552] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:38 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:40.087305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:40.088035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:40.095812 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:40.096329 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:40.096765 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:40.097476 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:40.097934 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:40.098404 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:40.165951 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:40.174148 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-88acf94e-2a12-471e-ba48-3654b87e19be tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.091820 Aug 22 16:32:40.174737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1312/2553] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:40 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:32:41.194965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:41.195670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:41.202040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:41.202515 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:41.202947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:41.203670 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:41.204113 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:41.204533 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:41.265649 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:41.273959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ff24b426-b073-42a9-85b3-6e30a6bd314e tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.082956 Aug 22 16:32:41.274518 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1242/2554] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:41 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:42.294612 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:42.295237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:42.301807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:42.302291 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:42.302735 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:42.303815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:42.304276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:42.304703 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:42.372787 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:42.384304 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c48b805e-a461-4716-ad24-658b95f001a9 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.093455 Aug 22 16:32:42.384871 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1313/2555] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:42 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:43.405945 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:43.406593 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:43.413973 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:43.414527 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:43.414970 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:43.415704 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:43.416242 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:43.416676 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:43.483632 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:43.491507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-450e9d6f-f833-4761-8623-27b8c97a949d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.089660 Aug 22 16:32:43.492073 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1243/2556] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:43 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:44.513677 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:44.514534 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:44.525757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:44.526266 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:44.526709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:44.527453 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:44.527913 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:44.528344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:44.601795 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:44.609935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-225ccec2-517a-4975-8d65-237bed141a56 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.100291 Aug 22 16:32:44.610502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1314/2557] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:44 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:32:45.632949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:45.633663 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:45.640166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:45.640645 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:45.641081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:45.641770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:45.642220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:45.642643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:45.704471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:45.712241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b5c6087e-c699-43fb-88d2-a5f6d7e4ba16 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.084159 Aug 22 16:32:45.712796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1244/2558] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:45 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:46.733335 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:46.733855 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:46.740416 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:46.740899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:46.741343 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:46.742035 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:46.742492 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:46.742922 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:46.806987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:46.814921 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f8d88238-337f-4e09-9559-c509d115f8e0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.085581 Aug 22 16:32:46.815516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1315/2559] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:46 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:47.840597 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:47.842089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:47.859605 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:47.860412 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:47.861139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:47.862306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:47.863213 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:47.863995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:47.982577 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:47.997139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6a51bc80-2c8b-4fdd-ba00-f351cac9b84d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.162735 Aug 22 16:32:47.998106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1245/2560] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:47 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:49.028629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:49.029242 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:49.035910 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:49.036393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:49.036827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:49.038103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:49.038558 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:49.038980 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:49.103440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:49.111682 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3dc7f2e9-ceab-4197-9215-1b03fb25a887 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.086858 Aug 22 16:32:49.112252 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1316/2561] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:49 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:50.133146 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:50.133870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:50.140983 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:50.141519 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:50.142003 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:50.142756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:50.143462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:50.143986 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:50.266166 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:50.281220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d42b8db0-b39a-4316-8e75-7114920057c8 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.151534 Aug 22 16:32:50.282225 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1246/2562] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:50 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:51.317816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:51.319133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:51.327059 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:51.327783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:51.328276 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:51.329160 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:51.329675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:51.330261 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:51.404636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:51.414262 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-270818d8-4b39-4c5a-a249-d138db55ddaa tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.100705 Aug 22 16:32:51.414909 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1317/2563] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:51 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:52.436199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:52.436795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:52.444135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:52.444621 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:52.445060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:52.445762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:52.446214 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:52.446639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:52.521221 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:52.534831 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f676d44d-341d-4f57-8077-ef38f4cf0138 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.102359 Aug 22 16:32:52.535887 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1247/2564] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:52 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:32:53.572985 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:53.574087 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:53.585993 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:53.586842 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:53.587642 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:53.588883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:53.589688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:53.590439 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:53.682757 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:53.697425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dbaa7100-ddfc-404e-89d2-55cfec2d9eb0 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.131711 Aug 22 16:32:53.698440 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1318/2565] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:53 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:54.730055 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:54.731062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:54.738902 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:54.739595 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:54.740690 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:54.741757 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:54.742357 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:54.742885 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:54.824071 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:54.833484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fddc220a-aa20-490b-a43c-4df667d95045 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.107819 Aug 22 16:32:54.834259 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1248/2566] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:54 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:55.867403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:55.868090 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:55.874947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:55.875525 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:55.876040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:55.876799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:55.877286 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:55.877754 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:55.945528 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:55.953723 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cec93cfb-98af-43e8-aebb-ddad00b94ade tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.090875 Aug 22 16:32:55.954288 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1319/2567] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:55 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:32:56.988532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:56.989165 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:56.996330 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:56.996803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:56.997231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:56.997923 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:56.998375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:56.998783 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:57.074199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:57.082549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-05f4c11f-8902-4d9d-9966-68e79ff6b20d tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.097845 Aug 22 16:32:57.083135 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1249/2568] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:56 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:58.104391 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:58.105032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:58.112843 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:58.113389 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:58.113833 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:58.114538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:58.115281 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:58.115756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:58.179716 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:58.187822 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-874aeea9-3614-49bd-948a-9176ea83b6ac tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.087466 Aug 22 16:32:58.188398 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1320/2569] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:58 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:32:59.208580 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:59.209285 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 4d19e272-2528-4d1f-b92b-34722e8821a9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:59.216355 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:59.216924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:59.217386 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:59.217877 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:59.218324 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:59.218770 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:59.288456 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50207197b8b46cea2ea40ca346bd8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f34dcc6dd4d6c9f52af4cc142bb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:32:59.296747 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e51a93ff-ca7d-4bb9-935e-7c116debac47 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9" status: 200 len: 1224 microversion: 2.1 time: 0.092205 Aug 22 16:32:59.297327 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1250/2570] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:59 2022] GET /compute/v2.1/servers/4d19e272-2528-4d1f-b92b-34722e8821a9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:32:59.791032 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:59.791591 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:59.798159 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:59.798645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:59.799116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:59.799848 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:59.800332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:59.800756 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:59.804166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=84 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:32:59.816464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] HTTP exception thrown: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Request method failure captured: Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b HTTP/1.1 Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept: application/json Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Connection: close Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Length: 0 Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Content-Type: application/json Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Host: 10.222.0.40 Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.11 Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjA6g8EEu6_-spRO1J6QV91c6iJjiaHYoSG-EJD8NCoiqcR11nIDDfCS7UETRKbzgt-MiAJktCKMAxNHDJD9cMLgsHTI4ETqd3dNRxyiJLKqya7wRsJJWdBgd2Y-FD4l0UpjVyF7t03WzvWj_ovVD0pxnMb6tsRSQNFwJcyfaCJm4uuj0 Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Id: cb5f34dcc6dd4d6c9f52af4cc142bb13 Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Role: reader,member Aug 22 16:32:59.818154 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Roles: reader,member Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cb5f34dcc6dd4d6c9f52af4cc142bb13", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}] Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Id: cb5f34dcc6dd4d6c9f52af4cc142bb13 Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User: tempest-TestVolumeBootPattern-1675342550-project Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Id: f50207197b8b46cea2ea40ca346bd8a0 Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-TestVolumeBootPattern-1675342550-project Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: method: > Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: exception: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.820352 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: action_args: {'id': '71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b'} Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:32:59.821571 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.823585 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.825904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Returning 404 to user: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:32:59.825904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9263ca74-7cdf-4315-a481-5349d6f1be75 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 404 len: 111 microversion: 2.1 time: 0.033154 Aug 22 16:32:59.825904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1321/2571] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:32:59 2022] DELETE /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:32:59.830065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:32:59.830669 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] [instance: 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:32:59.836813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:59.837294 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:59.837728 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:59.838417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:32:59.839098 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:32:59.839548 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:32:59.853944 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] HTTP exception thrown: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Request method failure captured: Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b HTTP/1.1 Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA6g8EEu6_-spRO1J6QV91c6iJjiaHYoSG-EJD8NCoiqcR11nIDDfCS7UETRKbzgt-MiAJktCKMAxNHDJD9cMLgsHTI4ETqd3dNRxyiJLKqya7wRsJJWdBgd2Y-FD4l0UpjVyF7t03WzvWj_ovVD0pxnMb6tsRSQNFwJcyfaCJm4uuj0 Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: cb5f34dcc6dd4d6c9f52af4cc142bb13 Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:32:59.855633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cb5f34dcc6dd4d6c9f52af4cc142bb13", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb5f34dcc6dd4d6c9f52af4cc142bb13"}]}] Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: cb5f34dcc6dd4d6c9f52af4cc142bb13 Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestVolumeBootPattern-1675342550 Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-TestVolumeBootPattern-1675342550-project Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: f50207197b8b46cea2ea40ca346bd8a0 Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestVolumeBootPattern-1675342550-project Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.856958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b'} Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:32:59.857553 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. Aug 22 16:32:59.858532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:32:59.859451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Returning 404 to user: Instance 71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:32:59.859451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-37532cb8-5556-48a2-a181-5f63a59cbfe4 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b" status: 404 len: 111 microversion: 2.1 time: 0.031954 Aug 22 16:32:59.859451 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1251/2572] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:32:59 2022] GET /compute/v2.1/servers/71f7f0e1-cc87-4a93-a40a-9c18a0fd5c4b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 16:33:04.293237 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:33:04.293840 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:34:02.943540 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:34:02.944446 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:34:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:34:12.208507 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:34:12.209192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:34:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:34:13.197181 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:34:13.197464 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:34:14.546028 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:34:14.546439 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:34:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:36:09.812356 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:36:09.813070 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:36:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:36:24.301640 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:36:24.302380 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:37:22.957012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:37:22.957654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:37:32.218661 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:37:32.219194 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:37:33.207690 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:37:33.207877 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:37:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:37:34.555476 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:37:34.556032 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:37:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:39:29.820617 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:39:29.821995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:39:44.312533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:39:44.313161 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:40:14.862393 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR oslo.messaging._drivers.impl_rabbit [-] [677f6770-985d-4059-b9ba-c69246eaeb8b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 22 16:40:14.863199 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=23 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:14.863992 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:15.108960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e253fad1-495a-4c97-a0f4-43153d83ac5d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Action: 'create', calling method: .version_select at 0x7fec9c481790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1066021686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkWiMYMhhrIRaLCLf7sgd1ofNazn7Dlta4iQIFigQV9NOuwh3/jbDO0u2H82fTNxWZTTu2+fZBwtuzkhcaNgYgCrlFb9L3ekPeis5OaJcSzNGof2wL9w3mdm5QqRP4oTA=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:40:15.126095 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-e253fad1-495a-4c97-a0f4-43153d83ac5d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Getting quotas for project fc5a0eefa294430f9b6405eb5f08d90b. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:40:15.130382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-e253fad1-495a-4c97-a0f4-43153d83ac5d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Getting quotas for user 792ae9f703a14677a4a147d4381cd731 and project fc5a0eefa294430f9b6405eb5f08d90b. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:40:15.160491 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e253fad1-495a-4c97-a0f4-43153d83ac5d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.299905 Aug 22 16:40:15.161085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1322/2573] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Aug 22 16:40:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:40:30.768036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5bc4e9-e1a3-4993-9cef-bfb47aa95408] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 22 16:40:30.769027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=25 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:30.769821 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=67 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:30.775263 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2006006288", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1066021686", "security_groups": [{"name": "tempest-secgroup-smoke-200233361"}], "networks": [{"uuid": "7f31142e-57a6-4ee2-b203-bdf93c8c894c"}], "block_device_mapping_v2": [{"uuid": "3c1dfbe0-caba-4eb6-94b8-5442458c2b56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:40:31.007870 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] validate_networks() for [('7f31142e-57a6-4ee2-b203-bdf93c8c894c', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 16:40:31.502047 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 16:40:31.502509 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 16:40:31.503009 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 16:40:31.503454 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 16:40:31.503872 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 16:40:31.515639 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:31.516413 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:31.517151 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:31.518382 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:31.519132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:31.519819 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:31.541030 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Getting quotas for project fc5a0eefa294430f9b6405eb5f08d90b. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 16:40:31.546210 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Getting quotas for user 792ae9f703a14677a4a147d4381cd731 and project fc5a0eefa294430f9b6405eb5f08d90b. Resources: {'instances', 'cores', 'ram'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 16:40:31.606069 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 16:40:31.608272 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c1dfbe0-caba-4eb6-94b8-5442458c2b56',volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 16:40:31.754508 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-38e73c2a-4ce9-48e5-aeb3-e8e2c23c283e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.988312 Aug 22 16:40:31.755089 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1252/2574] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Aug 22 16:40:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 16:40:31.763707 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:31.765116 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:31.769858 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ac73afd0-f473-4e47-b60a-5ce73bc9000e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:31.770564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ac73afd0-f473-4e47-b60a-5ce73bc9000e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:31.785337 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] [677f6770-985d-4059-b9ba-c69246eaeb8b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36042. Aug 22 16:40:31.920654 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ac73afd0-f473-4e47-b60a-5ce73bc9000e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:31.928825 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ac73afd0-f473-4e47-b60a-5ce73bc9000e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1089 microversion: 2.1 time: 0.166571 Aug 22 16:40:31.929394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1323/2575] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:31 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1089 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:32.951512 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:32.952234 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:32.961099 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:32.961610 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:32.962048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:32.962879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:32.963536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:32.964216 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:32.968614 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5bc4e9-e1a3-4993-9cef-bfb47aa95408] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36060. Aug 22 16:40:33.080080 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:33.088196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a5d219e5-c26e-436b-8825-c2b3fb06dbb4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1195 microversion: 2.1 time: 0.141857 Aug 22 16:40:33.088772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1253/2576] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:32 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1195 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:40:34.115212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:34.116442 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:34.126399 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:34.127115 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:34.128052 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:34.129382 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:34.130444 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:34.131365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:34.388766 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:34.396627 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fcd38b81-f750-44fe-b35c-41236059cb26 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1272 microversion: 2.1 time: 0.288780 Aug 22 16:40:34.397207 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1324/2577] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:34 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:34.927132 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-7b73bf92-d40a-4969-8438-e033d1f49749 req-19e98deb-b7d0-4450-b4c3-83f06428a683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed17856-c74e-4719-8875-b1abdaa6b5e8", "tag": "75669d8d-71c5-40c7-bf88-86d8604eda73"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:40:34.941785 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7b73bf92-d40a-4969-8438-e033d1f49749 req-19e98deb-b7d0-4450-b4c3-83f06428a683 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:34.942503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7b73bf92-d40a-4969-8438-e033d1f49749 req-19e98deb-b7d0-4450-b4c3-83f06428a683 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:34.943278 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7b73bf92-d40a-4969-8438-e033d1f49749 req-19e98deb-b7d0-4450-b4c3-83f06428a683 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:34.963771 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-7b73bf92-d40a-4969-8438-e033d1f49749 req-19e98deb-b7d0-4450-b4c3-83f06428a683 service nova] Creating event network-changed:75669d8d-71c5-40c7-bf88-86d8604eda73 for instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 on hv-cinder-85400 Aug 22 16:40:34.972882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-7b73bf92-d40a-4969-8438-e033d1f49749 req-19e98deb-b7d0-4450-b4c3-83f06428a683 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139028 Aug 22 16:40:34.973987 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1254/2578] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:40:35.417815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:35.418369 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:35.424680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:35.425157 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:35.425597 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:35.426297 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:35.426749 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:35.427171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:35.644350 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:35.652456 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-792c07d0-e27e-487e-b0d9-f85234076238 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.238537 Aug 22 16:40:35.653034 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1325/2579] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:35 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:36.675358 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:36.675978 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:36.682319 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:36.682802 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:36.683241 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:36.683975 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:36.684433 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:36.684853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:36.831270 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:36.839804 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6e14f028-38bc-4ad1-b48e-13019c17cde2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.169046 Aug 22 16:40:36.840205 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1255/2580] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:36 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:37.859938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:37.860537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:37.867428 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:37.867918 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:37.868346 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:37.869038 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:37.869482 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:37.869902 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:38.036462 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:38.047747 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-18eb68bb-50a3-4eb4-8fc8-05a66b66e8ed tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.191498 Aug 22 16:40:38.048330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1326/2581] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:37 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:39.068572 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:39.069377 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:39.076306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:39.076788 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:39.077218 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:39.084312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:39.084312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:39.084312 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:39.221824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:39.229856 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ecb94509-73b2-4b5f-b550-64d023597bd3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.165399 Aug 22 16:40:39.230427 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1256/2582] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:39 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:40.251693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:40.252213 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:40.259295 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:40.259804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:40.260330 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:40.260935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:40.261385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:40.261801 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:40.402425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:40.410664 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b83b0eb3-616d-423f-ae40-b5297a449fac tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.162925 Aug 22 16:40:40.411238 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1327/2583] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:40 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:41.431966 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:41.432569 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:41.438900 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:41.439404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:41.439836 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:41.440520 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:41.440965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:41.441383 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:41.529746 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:41.553701 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:41.579385 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:41.587306 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0a2537fb-1e1b-4785-9202-652553028aa3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.159300 Aug 22 16:40:41.587894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1257/2584] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:41 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:40:42.607905 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:42.608533 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:42.611516 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:40:42.617829 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:42.618328 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:42.618947 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:42.619715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:42.620173 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:42.620605 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:42.770973 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:42.781143 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-482480e2-c3f4-4798-ac15-fa6da67a311b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.177038 Aug 22 16:40:42.781737 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1328/2585] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:42 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:42.966245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:40:42.966904 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:40:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:40:43.805341 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:43.805874 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:43.812916 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:43.813410 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:43.813888 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:43.814604 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:43.815056 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:43.815534 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:43.961265 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:43.975822 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4524405b-69a3-4d72-af37-8ad2fd2156e9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.175293 Aug 22 16:40:43.976750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1258/2586] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:43 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:44.999011 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:44.999870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:45.006306 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:45.006786 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:45.007225 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:45.007961 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:45.008459 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:45.008826 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:45.153632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:45.161743 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-10455e7e-ebbe-4052-94a5-4e02e9936d52 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.166828 Aug 22 16:40:45.162320 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1329/2587] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:44 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:46.183418 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:46.183940 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:46.190535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:46.191027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:46.191506 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:46.192220 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:46.192678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:46.193106 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:46.335109 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:46.343759 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f381fc3b-dbf5-48c8-a2fd-c8d5db23ee03 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.164689 Aug 22 16:40:46.344332 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1259/2588] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:46 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:47.365454 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:47.366151 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:47.374158 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:47.374804 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:47.375241 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:47.376101 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:47.376537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:47.376959 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:47.458351 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-9a8e26f1-1858-4b38-90cf-617a7f460ee0 req-9788aed5-a437-4d8a-8e2c-785b0558a213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed17856-c74e-4719-8875-b1abdaa6b5e8", "name": "network-vif-plugged", "status": "completed", "tag": "75669d8d-71c5-40c7-bf88-86d8604eda73"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:40:47.479399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9a8e26f1-1858-4b38-90cf-617a7f460ee0 req-9788aed5-a437-4d8a-8e2c-785b0558a213 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:47.479399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9a8e26f1-1858-4b38-90cf-617a7f460ee0 req-9788aed5-a437-4d8a-8e2c-785b0558a213 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:47.479399 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9a8e26f1-1858-4b38-90cf-617a7f460ee0 req-9788aed5-a437-4d8a-8e2c-785b0558a213 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:47.501592 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-9a8e26f1-1858-4b38-90cf-617a7f460ee0 req-9788aed5-a437-4d8a-8e2c-785b0558a213 service nova] Creating event network-vif-plugged:75669d8d-71c5-40c7-bf88-86d8604eda73 for instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 on hv-cinder-85400 Aug 22 16:40:47.512813 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-9a8e26f1-1858-4b38-90cf-617a7f460ee0 req-9788aed5-a437-4d8a-8e2c-785b0558a213 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132496 Aug 22 16:40:47.514482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1260/2589] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:40:47.612348 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:47.623341 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bd11cd9b-6d3e-46a3-ba3a-cf27c9747664 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.261859 Aug 22 16:40:47.623958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1330/2590] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:47 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:48.651767 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:48.653048 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:48.665007 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:48.665899 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:48.666689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:48.667964 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:48.668756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:48.669503 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:48.912680 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:48.927468 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ec787e27-3078-4d60-a3b9-e3a937195a4e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1260 microversion: 2.1 time: 0.284254 Aug 22 16:40:48.928793 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1261/2591] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:48 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:49.951887 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:49.952911 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:49.964025 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:49.964572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:49.965056 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:49.965821 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:49.966318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:49.966784 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:50.147780 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:50.169061 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-72b71737-bb38-4c7c-94f5-b9dd592deb66 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1443 microversion: 2.1 time: 0.221545 Aug 22 16:40:50.170372 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1331/2592] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:49 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1443 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:50.195375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:50.196189 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:40:50.203654 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:50.204322 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:50.204879 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:50.205685 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:50.206231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:50.206756 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:50.402688 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:40:50.410864 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4691a59c-76ca-4d56-a40b-c34f66375dcc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1443 microversion: 2.1 time: 0.221448 Aug 22 16:40:50.411471 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1262/2593] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:40:50 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1443 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:40:52.228587 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:40:52.229375 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:40:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:40:52.464783 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-8b44c9c1-4995-4a20-921f-7bd13636131b req-0328d827-2de1-428d-945d-9bd496046c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed17856-c74e-4719-8875-b1abdaa6b5e8", "tag": "75669d8d-71c5-40c7-bf88-86d8604eda73"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:40:52.476228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-8b44c9c1-4995-4a20-921f-7bd13636131b req-0328d827-2de1-428d-945d-9bd496046c8e service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:40:52.476715 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-8b44c9c1-4995-4a20-921f-7bd13636131b req-0328d827-2de1-428d-945d-9bd496046c8e service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:40:52.477138 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-8b44c9c1-4995-4a20-921f-7bd13636131b req-0328d827-2de1-428d-945d-9bd496046c8e service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:40:52.489614 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-8b44c9c1-4995-4a20-921f-7bd13636131b req-0328d827-2de1-428d-945d-9bd496046c8e service nova] Creating event network-changed:75669d8d-71c5-40c7-bf88-86d8604eda73 for instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 on hv-cinder-85400 Aug 22 16:40:52.496005 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-8b44c9c1-4995-4a20-921f-7bd13636131b req-0328d827-2de1-428d-945d-9bd496046c8e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036174 Aug 22 16:40:52.496688 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1332/2594] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:40:58.769139 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9b746631-d69b-4cff-9910-de0bf7912097 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] Calling method '.version_select at 0x7fec9c0a9ee0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:40:58.805193 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9b746631-d69b-4cff-9910-de0bf7912097 tempest-TestVolumeBootPattern-1675342550 tempest-TestVolumeBootPattern-1675342550-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-579268431" status: 202 len: 0 microversion: 2.1 time: 0.042094 Aug 22 16:40:58.806493 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1263/2595] 10.222.0.40 () {58 vars in 1260 bytes} [Mon Aug 22 16:40:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-579268431 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:42:33.219289 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:42:33.220186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:42:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:42:34.566544 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:42:34.568012 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:42:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:42:47.266694 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: ERROR oslo.messaging._drivers.impl_rabbit [-] [677f6770-985d-4059-b9ba-c69246eaeb8b] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 22 16:42:47.268166 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=22 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:42:47.270771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=50 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:42:47.281969 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:42:47.282625 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:47.291771 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:47.292499 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:47.293260 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:47.294566 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:47.295465 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:47.296220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:47.336033 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lazy-loading 'flavor' on Instance uuid 0ed17856-c74e-4719-8875-b1abdaa6b5e8 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 16:42:47.432427 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9120b43c-962b-4a05-af69-5aebdd01510e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "POST /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8/action" status: 202 len: 0 microversion: 2.1 time: 0.167570 Aug 22 16:42:47.433047 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1333/2596] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:42:47 2022] POST /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:42:47.439901 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5bc4e9-e1a3-4993-9cef-bfb47aa95408] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 22 16:42:47.440861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=54 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:42:47.442590 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:42:47.447424 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:47.448061 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:47.458845 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:47.459573 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:47.460027 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:47.461036 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:47.461535 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:47.461981 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:47.660428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:47.674847 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d57069fb-ec32-4c50-859b-ec580710c52e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.236815 Aug 22 16:42:47.675480 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1264/2597] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:47 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:42:48.700888 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:48.701693 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:48.710730 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:48.711257 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:48.711884 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:48.712629 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:48.713103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:48.713538 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:48.727513 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] [677f6770-985d-4059-b9ba-c69246eaeb8b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36258. Aug 22 16:42:48.890099 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:48.906537 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d9f111cd-959a-4aa9-9e48-cd04edf5f5f6 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.212748 Aug 22 16:42:48.907667 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1334/2598] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:48 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:42:49.933827 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:49.934959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:49.948556 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:49.949404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:49.950169 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:49.951470 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:49.952303 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:49.953155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:49.992957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5bc4e9-e1a3-4993-9cef-bfb47aa95408] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36262. Aug 22 16:42:50.199795 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:50.209861 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-012990b0-e89f-4e75-a5ce-d317aec34e8e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.283680 Aug 22 16:42:50.210482 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1265/2599] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:49 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:42:51.244645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:51.245450 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:51.253256 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:51.253816 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:51.255103 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:51.256344 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:51.257220 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:51.257899 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:51.480989 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:51.495772 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0ca639b9-d365-48d2-98fd-bb97e1d1c8c9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.254826 Aug 22 16:42:51.496622 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1335/2600] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:51 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:42:52.523430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:52.524000 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:52.531128 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:52.531652 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:52.532066 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:52.532772 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:52.533219 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:52.533653 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:52.949207 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:52.962679 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9daadc02-259b-4b6a-96e6-8998d5f22bf2 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.443504 Aug 22 16:42:52.963689 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1266/2601] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:52 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:42:53.985272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:53.986021 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:53.993767 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:53.994265 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:53.994710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:53.995484 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:53.995943 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:53.996377 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:54.151721 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:54.161847 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b7c7a8ec-5cba-43f4-8ee9-2b323f3c0c47 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.180335 Aug 22 16:42:54.162469 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1336/2602] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:53 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:42:55.183674 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:55.184584 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:55.191926 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:55.192435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:55.192871 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:55.193585 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:55.194040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:55.194462 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:55.393296 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:55.403060 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d5728bc8-70db-4f54-884a-385718feb8d4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.223692 Aug 22 16:42:55.403786 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1267/2603] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:55 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:42:56.431996 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:56.440653 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:56.450681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:56.451171 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:56.451645 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:56.452419 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:56.452879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:56.453305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:56.626381 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:56.638710 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d15eeb1d-9aaa-4dec-b26d-1578c429b2b5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.210329 Aug 22 16:42:56.639770 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1337/2604] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:56 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:42:57.673803 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:57.674440 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:57.681406 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:57.681896 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:57.682335 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:57.683121 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:57.683603 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:57.684040 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:57.941301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:57.950062 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9c6bcd6c-1314-4d19-a5af-f65d07a5a2b9 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.280202 Aug 22 16:42:57.950660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1268/2605] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:57 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:42:58.990719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:42:58.991827 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:42:59.002332 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:59.003128 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:59.004541 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:59.005807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:42:59.006613 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:42:59.007354 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:42:59.189302 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:42:59.203365 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6090fec6-cd89-4e7d-ae94-aeb438f85e1c tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.219444 Aug 22 16:42:59.204388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1338/2606] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:42:58 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:00.237796 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:00.238423 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:00.245739 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:00.246230 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:00.246665 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:00.247417 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:00.247868 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:00.248300 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:00.454119 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:00.466186 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-03246df4-fc12-4c83-98e9-e30952c293bc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.232226 Aug 22 16:43:00.466999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1269/2607] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:00 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:01.502601 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:01.503385 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:01.511236 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:01.511870 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:01.512403 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:01.513228 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:01.513815 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:01.514370 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:01.670960 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:01.685624 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-186b0195-7903-489a-bdfa-67b4a1ba42c5 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1508 microversion: 2.1 time: 0.186722 Aug 22 16:43:01.686722 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1339/2608] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:01 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:43:01.708328 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:43:01.708929 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:01.715932 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:01.716420 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:01.716853 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:01.717554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:01.717997 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:01.718414 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:01.773111 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121080) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 16:43:01.888337 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bc650f39-77a5-44c9-8e97-718f75dc80fc tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "POST /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8/action" status: 202 len: 0 microversion: 2.1 time: 0.184454 Aug 22 16:43:01.889484 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1270/2609] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Aug 22 16:43:01 2022] POST /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 16:43:01.901904 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:01.902864 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:01.914762 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:01.915668 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:01.916564 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:01.917935 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:01.919192 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:01.920185 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:02.127208 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:02.136610 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c51dba1d-31c2-4089-9fc6-b604cc703c49 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1516 microversion: 2.1 time: 0.241659 Aug 22 16:43:02.137250 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1340/2610] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:01 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:43:03.162435 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:03.163275 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:03.170212 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:03.170749 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:03.171266 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:03.172074 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:03.172582 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:03.173137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:03.356514 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:03.366137 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b3a2ecbc-ef15-4aea-ba00-d4ea3ac90c70 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1518 microversion: 2.1 time: 0.209799 Aug 22 16:43:03.366744 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1271/2611] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:03 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:43:04.073007 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-fb6127f9-6f37-406c-ae9d-c35e54d40017 req-5bc1f5a3-2e3c-486d-aede-7d3cd255bd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed17856-c74e-4719-8875-b1abdaa6b5e8", "name": "network-vif-unplugged", "status": "completed", "tag": "75669d8d-71c5-40c7-bf88-86d8604eda73"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:43:04.088611 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-fb6127f9-6f37-406c-ae9d-c35e54d40017 req-5bc1f5a3-2e3c-486d-aede-7d3cd255bd43 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:04.089433 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-fb6127f9-6f37-406c-ae9d-c35e54d40017 req-5bc1f5a3-2e3c-486d-aede-7d3cd255bd43 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:04.090071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-fb6127f9-6f37-406c-ae9d-c35e54d40017 req-5bc1f5a3-2e3c-486d-aede-7d3cd255bd43 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:04.105695 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-fb6127f9-6f37-406c-ae9d-c35e54d40017 req-5bc1f5a3-2e3c-486d-aede-7d3cd255bd43 service nova] Creating event network-vif-unplugged:75669d8d-71c5-40c7-bf88-86d8604eda73 for instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 on hv-cinder-85400 Aug 22 16:43:04.111602 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-fb6127f9-6f37-406c-ae9d-c35e54d40017 req-5bc1f5a3-2e3c-486d-aede-7d3cd255bd43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045906 Aug 22 16:43:04.112394 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1341/2612] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:43:04.398101 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:04.399248 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:04.412467 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:04.413517 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:04.414171 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:04.415539 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:04.416375 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:04.417158 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:04.739657 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:04.756852 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-55a32062-3ddd-45af-ba34-274d99121820 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.365837 Aug 22 16:43:04.760917 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1272/2613] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:04 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:05.794425 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:05.795719 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:05.805856 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:05.806548 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:05.807318 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:05.808681 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:05.809408 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:05.810170 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:06.008551 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:06.017053 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-91a15ca7-ada4-4f83-a9e8-3aa8e6a54a33 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.232157 Aug 22 16:43:06.017632 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1342/2614] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:05 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:07.045511 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:07.046643 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:07.058686 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:07.059633 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:07.060391 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:07.061693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:07.062487 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:07.063199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:07.282053 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:07.296081 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c3fbe00d-c090-41b3-823e-af72d7f169aa tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.257299 Aug 22 16:43:07.296976 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1273/2615] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:07 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:08.326144 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:08.327251 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:08.339300 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:08.340040 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:08.340778 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:08.341949 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:08.342732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:08.343502 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:08.515572 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:08.530057 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f212245-2219-43f5-83dc-10f9b0f5ad54 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.210769 Aug 22 16:43:08.531073 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1343/2616] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:08 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:09.564892 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:09.565957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:09.573693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:09.574199 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:09.574647 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:09.575425 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:09.575894 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:09.576323 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:09.754524 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:09.766311 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a750e1b2-fb81-424e-96ca-6a8f5d58a242 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.205575 Aug 22 16:43:09.766948 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1274/2617] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:09 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:43:10.789137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:10.789811 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:10.798407 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:10.801709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:10.801709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:10.801709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:10.801709 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:10.802186 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:11.025738 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:11.039163 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b17ee660-af19-425b-9076-71e07bcd7a86 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.254319 Aug 22 16:43:11.039820 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1344/2618] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:10 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:43:12.067965 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:12.069162 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:12.081696 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:12.082536 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:12.083313 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:12.084949 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:12.085737 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:12.086678 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:12.301430 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:12.311127 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-054a171f-89be-47d0-b5f8-a079d4145b77 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.250859 Aug 22 16:43:12.311750 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1275/2619] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:12 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:13.336987 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:13.337718 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:13.349178 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:13.349675 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:13.350113 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:13.351096 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:13.351660 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:13.352091 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:13.513838 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:13.529065 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-997e42d1-15c8-40db-8b7b-19155a3e0678 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.197403 Aug 22 16:43:13.529928 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1345/2620] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:13 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:14.557972 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:14.558984 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:14.567882 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:14.568629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:14.569237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:14.570088 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:14.570720 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:14.571267 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:14.791145 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:14.800910 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7fdcdcb9-21d3-4501-8b0e-5bd720a2be1d tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.247552 Aug 22 16:43:14.801507 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1276/2621] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:14 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:15.836247 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:15.837118 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:15.844137 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:15.844803 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:15.845300 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:15.846165 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:15.846680 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:15.847880 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:16.062875 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:16.076278 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6baaedeb-7cf6-4c4f-bbec-36eafc436a2b tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.245498 Aug 22 16:43:16.077085 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1346/2622] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:15 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 16:43:16.151693 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-a54cf3e9-3a85-4689-a69f-6754395e2b13 req-5368444d-c988-414c-98fd-add44e6a4fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed17856-c74e-4719-8875-b1abdaa6b5e8", "name": "network-vif-plugged", "status": "completed", "tag": "75669d8d-71c5-40c7-bf88-86d8604eda73"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:43:16.164444 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a54cf3e9-3a85-4689-a69f-6754395e2b13 req-5368444d-c988-414c-98fd-add44e6a4fc9 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:16.164931 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a54cf3e9-3a85-4689-a69f-6754395e2b13 req-5368444d-c988-414c-98fd-add44e6a4fc9 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:16.165428 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a54cf3e9-3a85-4689-a69f-6754395e2b13 req-5368444d-c988-414c-98fd-add44e6a4fc9 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:16.179886 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-a54cf3e9-3a85-4689-a69f-6754395e2b13 req-5368444d-c988-414c-98fd-add44e6a4fc9 service nova] Creating event network-vif-plugged:75669d8d-71c5-40c7-bf88-86d8604eda73 for instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 on hv-cinder-85400 Aug 22 16:43:16.185370 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-a54cf3e9-3a85-4689-a69f-6754395e2b13 req-5368444d-c988-414c-98fd-add44e6a4fc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038436 Aug 22 16:43:16.185988 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1277/2623] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:43:17.106802 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:17.108004 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:17.120028 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:17.120883 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:17.121684 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:17.122941 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:17.123807 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:17.124559 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:17.303388 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:17.306201 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:43:17.318063 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e2fd6930-e7f7-4d89-a1d4-7acec7dfaac3 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1574 microversion: 2.1 time: 0.219152 Aug 22 16:43:17.318669 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1347/2624] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:17 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:43:18.344681 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:43:18.346142 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:43:18.348958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:43:18.357144 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:18.357958 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:18.358660 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:18.359876 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:43:18.360457 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:43:18.361177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:43:18.368354 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:43:18.594666 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:43:18.605909 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9b3bede9-1ea4-42ad-8d6c-a72682047135 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1561 microversion: 2.1 time: 0.267568 Aug 22 16:43:18.606392 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1278/2625] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:43:18 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1561 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:44:02.976415 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:44:02.977163 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:44:12.238958 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:44:12.239636 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:44:35.754782 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=30 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:44:35.761177 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:44:35.763065 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=5 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:44:35.763386 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:44:35.764338 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:44:35.777212 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:35.777972 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:35.778774 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:35.779704 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:35.780458 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:35.781200 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:35.831732 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 16:44:35.899387 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-5000a6b2-d2f5-4c72-96aa-921f2f91cfe4 req-fb67e445-d036-4b24-909c-e711e2316da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed17856-c74e-4719-8875-b1abdaa6b5e8", "tag": "75669d8d-71c5-40c7-bf88-86d8604eda73"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:44:35.916196 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-5000a6b2-d2f5-4c72-96aa-921f2f91cfe4 req-fb67e445-d036-4b24-909c-e711e2316da6 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:35.916898 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-5000a6b2-d2f5-4c72-96aa-921f2f91cfe4 req-fb67e445-d036-4b24-909c-e711e2316da6 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:35.917957 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-5000a6b2-d2f5-4c72-96aa-921f2f91cfe4 req-fb67e445-d036-4b24-909c-e711e2316da6 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:35.939549 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-5000a6b2-d2f5-4c72-96aa-921f2f91cfe4 req-fb67e445-d036-4b24-909c-e711e2316da6 service nova] Creating event network-changed:75669d8d-71c5-40c7-bf88-86d8604eda73 for instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 on hv-cinder-85400 Aug 22 16:44:35.952352 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-5000a6b2-d2f5-4c72-96aa-921f2f91cfe4 req-fb67e445-d036-4b24-909c-e711e2316da6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192856 Aug 22 16:44:35.954826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1279/2626] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:44:35.964180 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-07564809-ec3e-4428-ba23-6987c3354f81 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 204 len: 0 microversion: 2.1 time: 0.211009 Aug 22 16:44:35.965478 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1348/2627] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Aug 22 16:44:35 2022] DELETE /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 16:44:35.981156 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:44:35.982662 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:44:35.995237 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:35.996245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:35.997244 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:35.998855 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:35.999762 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:36.000485 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:36.202947 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:44:36.213642 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-37aeea86-659e-41c2-8f01-3e63eb420886 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.240836 Aug 22 16:44:36.214286 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1280/2628] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:44:35 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:44:37.239547 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:44:37.240814 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:44:37.248792 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:37.249421 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:37.250014 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:37.251666 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:37.252255 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:37.253071 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:37.527197 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:44:37.538988 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4fc9ddc5-a9f8-4eaa-9ac0-ef587738512e tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1567 microversion: 2.1 time: 0.305368 Aug 22 16:44:37.540441 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1349/2629] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:44:37 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:44:38.484824 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-09bfc9fb-9cd8-4d45-9138-3e46506c8ab6 req-f8c6a609-b0a8-4218-bd34-90b4a881c0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed17856-c74e-4719-8875-b1abdaa6b5e8", "name": "network-vif-deleted", "tag": "75669d8d-71c5-40c7-bf88-86d8604eda73"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 16:44:38.497033 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-09bfc9fb-9cd8-4d45-9138-3e46506c8ab6 req-f8c6a609-b0a8-4218-bd34-90b4a881c0a7 service nova] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:38.497629 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-09bfc9fb-9cd8-4d45-9138-3e46506c8ab6 req-f8c6a609-b0a8-4218-bd34-90b4a881c0a7 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:38.497953 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-09bfc9fb-9cd8-4d45-9138-3e46506c8ab6 req-f8c6a609-b0a8-4218-bd34-90b4a881c0a7 service nova] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:38.524236 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-09bfc9fb-9cd8-4d45-9138-3e46506c8ab6 req-f8c6a609-b0a8-4218-bd34-90b4a881c0a7 service nova] Creating event network-vif-deleted:75669d8d-71c5-40c7-bf88-86d8604eda73 for instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 on hv-cinder-85400 Aug 22 16:44:38.532342 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-09bfc9fb-9cd8-4d45-9138-3e46506c8ab6 req-f8c6a609-b0a8-4218-bd34-90b4a881c0a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051454 Aug 22 16:44:38.533532 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1281/2630] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Aug 22 16:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 16:44:38.566359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:44:38.568879 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:44:38.577648 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:38.578142 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:38.578577 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:38.579359 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:38.580092 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:38.580305 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:38.683939 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792ae9f703a14677a4a147d4381cd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5a0eefa294430f9b6405eb5f08d90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 16:44:38.694550 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-93794efa-1fef-4ec3-97c7-d2a9cae65f89 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 200 len: 1220 microversion: 2.1 time: 0.134827 Aug 22 16:44:38.695272 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1350/2631] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:44:38 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 16:44:39.733432 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:44:39.734404 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] [instance: 0ed17856-c74e-4719-8875-b1abdaa6b5e8] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 16:44:39.745401 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:39.746155 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:39.746826 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:39.747995 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Acquiring lock "c9b6efaf-c661-4a43-9954-830521140ee8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:44:39.748711 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:44:39.749384 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Lock "c9b6efaf-c661-4a43-9954-830521140ee8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:44:39.773924 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] HTTP exception thrown: Instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 could not be found. Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Request method failure captured: Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 HTTP/1.1 Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept: application/json Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Connection: close Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Length: 0 Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Content-Type: application/json Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Host: 10.222.0.40 Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.11 Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjA7FpRo7Zjodtnq-WkhbsPDgROphy3xT9Nz2T4UVtLReGUXi0DudcK_9QnDd3AevbodXgni-9Q7SoHsyvj0zmuEWwIUMZNQoxOxvimbuXMagr_Kuj4Gqi-saU163k8kHYmBiZnhWHpgJoG99OoafC1zYhVKx5X-LAsD5r9Qyt2zNoFSw Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Id: fc5a0eefa294430f9b6405eb5f08d90b Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestShelveInstance-698322331 Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Role: reader,member Aug 22 16:44:39.776959 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Roles: reader,member Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc5a0eefa294430f9b6405eb5f08d90b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc5a0eefa294430f9b6405eb5f08d90b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc5a0eefa294430f9b6405eb5f08d90b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc5a0eefa294430f9b6405eb5f08d90b"}]}] Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestShelveInstance-698322331 Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Id: fc5a0eefa294430f9b6405eb5f08d90b Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestShelveInstance-698322331 Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User: tempest-TestShelveInstance-698322331-project Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Id: 792ae9f703a14677a4a147d4381cd731 Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestShelveInstance-698322331-project Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: method: > Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: exception: Instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 could not be found. Aug 22 16:44:39.779255 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: action_args: {'id': '0ed17856-c74e-4719-8875-b1abdaa6b5e8'} Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 could not be found. Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 16:44:39.780498 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 could not be found. Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 could not be found. Aug 22 16:44:39.781730 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Aug 22 16:44:39.782692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Returning 404 to user: Instance 0ed17856-c74e-4719-8875-b1abdaa6b5e8 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 16:44:39.782692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d5f26eff-9f96-4e8f-927f-1ce39d7ac7b4 tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8" status: 404 len: 111 microversion: 2.1 time: 0.053068 Aug 22 16:44:39.782692 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1282/2632] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Aug 22 16:44:39 2022] GET /compute/v2.1/servers/0ed17856-c74e-4719-8875-b1abdaa6b5e8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 16:44:40.048799 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d3e4bfba-5ddc-4d71-add1-51aa4ec53fff tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] Calling method '.version_select at 0x7fec9c16caf0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:44:40.094133 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d3e4bfba-5ddc-4d71-add1-51aa4ec53fff tempest-TestShelveInstance-698322331 tempest-TestShelveInstance-698322331-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1066021686" status: 202 len: 0 microversion: 2.1 time: 0.053220 Aug 22 16:44:40.095383 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1351/2633] 10.222.0.40 () {58 vars in 1254 bytes} [Mon Aug 22 16:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1066021686 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 16:45:54.576301 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:45:54.577554 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:45:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:47:22.986833 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:47:22.987999 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:47:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:47:32.250976 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:47:32.251938 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:47:33.236292 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:47:33.236573 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:47:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:47:49.836245 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:47:49.837122 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:47:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:49:14.587039 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:49:14.588231 dv-cinder-854004-1-iscsi devstack@n-api.service[121080]: Mon Aug 22 16:49:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 16:49:44.328070 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 16:49:44.329198 dv-cinder-854004-1-iscsi devstack@n-api.service[121079]: Mon Aug 22 16:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!